-- Logs begin at Thu 2022-05-26 19:12:58 UTC, end at Thu 2022-05-26 20:33:22 UTC. -- May 26 19:57:44.987766 dv-cinder-842131-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 19:57:44.998428 dv-cinder-842131-1-smb devstack@keystone.service[80402]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 19:57:44 2022] *** May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: nodename: dv-cinder-842131-1-smb May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: machine: x86_64 May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: clock source: unix May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: pcre jit disabled May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: detected number of CPU cores: 4 May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: current working directory: / May 26 19:57:45.000463 dv-cinder-842131-1-smb devstack@keystone.service[80402]: detected binary path: /usr/bin/uwsgi-core May 26 19:57:45.001101 dv-cinder-842131-1-smb devstack@keystone.service[80402]: your processes number limit is 47680 May 26 19:57:45.001101 dv-cinder-842131-1-smb devstack@keystone.service[80402]: your memory page size is 4096 bytes May 26 19:57:45.001101 dv-cinder-842131-1-smb devstack@keystone.service[80402]: detected max file descriptor number: 2048 May 26 19:57:45.001101 dv-cinder-842131-1-smb devstack@keystone.service[80402]: lock engine: pthread robust mutexes May 26 19:57:45.001101 dv-cinder-842131-1-smb devstack@keystone.service[80402]: thunder lock: enabled May 26 19:57:45.001101 dv-cinder-842131-1-smb devstack@keystone.service[80402]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 19:57:45.001101 dv-cinder-842131-1-smb devstack@keystone.service[80402]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 19:57:45.045325 dv-cinder-842131-1-smb devstack@keystone.service[80402]: Python main interpreter initialized at 0x557aae6209c0 May 26 19:57:45.045325 dv-cinder-842131-1-smb devstack@keystone.service[80402]: python threads support enabled May 26 19:57:45.045325 dv-cinder-842131-1-smb devstack@keystone.service[80402]: your server socket listen backlog is limited to 100 connections May 26 19:57:45.045325 dv-cinder-842131-1-smb devstack@keystone.service[80402]: your mercy for graceful operations on workers is 90 seconds May 26 19:57:45.045642 dv-cinder-842131-1-smb devstack@keystone.service[80402]: mapped 403077 bytes (393 KB) for 2 cores May 26 19:57:45.045744 dv-cinder-842131-1-smb devstack@keystone.service[80402]: *** Operational MODE: preforking *** May 26 19:57:45.046011 dv-cinder-842131-1-smb devstack@keystone.service[80402]: *** uWSGI is running in multiple interpreter mode *** May 26 19:57:45.046011 dv-cinder-842131-1-smb devstack@keystone.service[80402]: spawned uWSGI master process (pid: 80402) May 26 19:57:45.046190 dv-cinder-842131-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 19:57:45.050908 dv-cinder-842131-1-smb devstack@keystone.service[80402]: spawned uWSGI worker 1 (pid: 80412, cores: 1) May 26 19:57:45.050908 dv-cinder-842131-1-smb devstack@keystone.service[80402]: spawned uWSGI worker 2 (pid: 80413, cores: 1) May 26 19:57:45.050908 dv-cinder-842131-1-smb devstack@keystone.service[80402]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 19:57:50.690124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:57:50.690124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: from cryptography.utils import int_from_bytes May 26 19:57:50.690825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:57:50.690825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: from cryptography.utils import int_from_bytes May 26 19:57:50.711611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:57:50.711611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: from cryptography.utils import int_from_bytes May 26 19:57:50.712185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:57:50.712185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: from cryptography.utils import int_from_bytes May 26 19:57:50.740413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:57:50.740604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:57:50.740795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] command line args: [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:57:50.741062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:57:50.741239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ================================================================================ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:57:50.741490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] admin_token = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.741736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config_dir = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.741922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.742101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] config_source = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.742277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] debug = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.742474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.743647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.743647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.743647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.743647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.743901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.743901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_config_append = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.744054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.744830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_dir = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.744998 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.745234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.745484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.745733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.745980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.746158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.746335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.746578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.746828 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.747081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.747314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.747546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.747776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.748023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.748268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.748540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.749025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.749204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] publish_errors = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.749440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.749666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.749842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.750085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.750317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.750547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] standard_threads = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.750777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.751043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.751218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.751393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_journal = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.751568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_json = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.751742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_stderr = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.751917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] use_syslog = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.752147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.752401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.752639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.752899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.753137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.753387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.753624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.753872 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.754108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.754353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.754597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.754867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.755101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.755347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.755580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.755826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.756071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.756308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.756558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.756807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.757049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.757285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.757535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.757795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.758046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.758293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.758523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.758753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.759014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.759249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.759501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.759737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:57:50.759869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.759990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:57:50.760135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] command line args: [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:57:50.760402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:57:50.760578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ================================================================================ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:57:50.760847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] admin_token = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.761094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config_dir = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.761367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.761482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.761482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] config_source = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.761698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] debug = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.762785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.762785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.763951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.764619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.764742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.764858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.764980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.765103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.765103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.765103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_config_append = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.765103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.766544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.766658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_dir = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.766783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.766932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.767157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.767488 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.767719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.767719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.768402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.768513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.768625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.768744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.768856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.768974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.769091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.769203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.769313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.769431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.769543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.769655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.769772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.769772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.769980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.770099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.770218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] publish_errors = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.770330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.770446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.770565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.770676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.770787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.770943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.771055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.771165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.771289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.771402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.771402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] standard_threads = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.771622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.771837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.771964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.772089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.772201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.772312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.772423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.772534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_journal = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.772656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.772769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_json = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.772769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_stderr = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.772985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.773095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] use_syslog = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.773207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.773396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:57:50.773510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.773627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.773743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.773864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.773977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.774926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.775040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.775157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.775268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.775385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.775998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.776926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.777947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.778986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.779985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.780993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.781884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.782963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.external = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.783978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.password = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.784888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] auth.token = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.785989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.786912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.787958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.788998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.789902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.790953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.791227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.791870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.791985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.792969 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.793899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.794935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.795976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.796979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.797891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.external = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.798936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.password = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] auth.token = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.799927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.800896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.801926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.802900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.803913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.804939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.805965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.806954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.807988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.808895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.809924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.810959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.811990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.812901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.813935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.814884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.815981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.816989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.817902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.818948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819173 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.819894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.820946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.821059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.821170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.821527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.821715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.821831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.821943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.822920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.823947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.824955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.825848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.826911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.827938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.828947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.829987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.830904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.831938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832394 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.832964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.833370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.833496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.833610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.833736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.833851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.833964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.834407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.835236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.836948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.837363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.837476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.837635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.837869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.838637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.838890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.839140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.839387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.839616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.839859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.840148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.840407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.840648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.840893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.841129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.841377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.841612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.841847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.842081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.842316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.842559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.842793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.843067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.843302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.843547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.843782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.844024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.844253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.844490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.844723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:57:50.844891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:57:50.861920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.862152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.862377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.870176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.870403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.870625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.871016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.880600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.899210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.899399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.901375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.901608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.952705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:50.952979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.004620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.004852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.005164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.005399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.070179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.070402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.070490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.070628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.070714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.070863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.070948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.071086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.071171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.071553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.071644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.071772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.095988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.096125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.096209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.096345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.096427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.096557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.096770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.107648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.107911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.120889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.121970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.122062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.122182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.122264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80412) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.122392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.122603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80413) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:57:51.140466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.140626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.140713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:57:51.140838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:57:51.140990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.141170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.141251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:57:51.141368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:57:51.141451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.141633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.141715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.141889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.141970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.142144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.142225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.142398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.153515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.153750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.154017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.154295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.154957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.155234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.155500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.155778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.162408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.163910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.165738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.166015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.166813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.167113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.167389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.167640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.167824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.167906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.168102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.168270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.168381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.168542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.168659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.168813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.168941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.169081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.169195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.169454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.169828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.170095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.170365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.170628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.196075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.197891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.198095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.198374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.199665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.199943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.203683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.203960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.204238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.205216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.205492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.205766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.211582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.211862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.213106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.213384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.216441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.216840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.217120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.217404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.217678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.217935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.218019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.218207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.218340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.218469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.218628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.218954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.219230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.219504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.219773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.220039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.237699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.237978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.239237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.239512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.242676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.244232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.246986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.247275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.248466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.248762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.252358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.253918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.256008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.257539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.259843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.260187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.260508 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.260795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.261085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.261362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.261447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.261682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.261970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.262262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.262546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.262830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.280427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.280706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.280969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.281227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.281832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.282113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.282376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.282635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.289276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.290700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.291006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.291787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.292957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.293243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.294884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.295164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.295441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.295720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.295993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.296343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.296620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.296897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.297176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.297452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.310091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.310377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.310662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.310968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.311246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.311506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.311590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.311783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.311865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.312059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.312334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.312606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.312875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.313152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.330159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.331450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.333473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.334718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.336832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.338122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.338480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.339770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.340157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.340439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.340721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.341384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.341667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.341955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.348220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.349411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.349834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.351042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.353112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.353406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.354861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.355141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.355422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.355558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.355704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.356337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.364863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.365144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.365521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.367177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.367461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.367844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.374036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80413) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.374317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.374589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.374877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.375146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.375417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.375687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.375965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.376229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.376379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80412) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:57:51.376507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.376657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.376773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.376934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.377019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.377208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.377299 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.377476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.377561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80413) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.377744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.378029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.378300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.378573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.378857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.379122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.379379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.379646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.379917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80412) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:57:51.416819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557aae6209c0 pid: 80413 (default app) May 26 19:57:51.419349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557aae6209c0 pid: 80412 (default app) May 26 19:57:51.419996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbadaf-7e9e-4310-b930-7aef5e7af123 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:57:51.420294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbadaf-7e9e-4310-b930-7aef5e7af123 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:57:51.420568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbadaf-7e9e-4310-b930-7aef5e7af123 None None] PATH_INFO: `/v3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:57:51.424868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu May 26 19:57:51 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:57:59.367682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd7e24-c245-4887-9cc7-2cd013b0ad4b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:57:59.368239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd7e24-c245-4887-9cc7-2cd013b0ad4b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:57:59.368239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd7e24-c245-4887-9cc7-2cd013b0ad4b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:57:59.373224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:57:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:57:59.378533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:57:59.378951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:57:59.379113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:57:59.446051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: INFO dbcounter [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] Registered counter for database keystone May 26 19:57:59.467293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG oslo_db.sqlalchemy.engines [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:57:59.473384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writer thread running {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:57:59.647103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG passlib.handlers.bcrypt [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80413) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 19:57:59.647525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG passlib.handlers.bcrypt [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80413) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 19:57:59.703162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:57:59.704736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:57:59.826092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:57:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 26 19:58:00.016837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd7e24-c245-4887-9cc7-2cd013b0ad4b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:00.084849 dv-cinder-842131-1-smb devstack@keystone.service[80412]: INFO dbcounter [None req-31bd7e24-c245-4887-9cc7-2cd013b0ad4b None None] Registered counter for database keystone May 26 19:58:00.103568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG oslo_db.sqlalchemy.engines [None req-31bd7e24-c245-4887-9cc7-2cd013b0ad4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:58:00.109680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writer thread running {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:58:00.227763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd7e24-c245-4887-9cc7-2cd013b0ad4b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:00.232528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ecb22-1314-465d-9a85-af7efda4f155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:00.233180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ecb22-1314-465d-9a85-af7efda4f155 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:00.233467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ecb22-1314-465d-9a85-af7efda4f155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:00.233744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ecb22-1314-465d-9a85-af7efda4f155 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:00.241851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ecb22-1314-465d-9a85-af7efda4f155 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:00.293469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c45ecb22-1314-465d-9a85-af7efda4f155 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 19:58:00.293763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ecb22-1314-465d-9a85-af7efda4f155 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:00.303054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 26 19:58:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 19:58:00.309625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:00.324336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd288a16-52cf-4810-9481-d2f6b2a219e6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:00.328669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b9d66-8394-4fb7-8364-6f76df2d709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:00.329764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9d66-8394-4fb7-8364-6f76df2d709b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:00.330045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9d66-8394-4fb7-8364-6f76df2d709b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:00.330323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b9d66-8394-4fb7-8364-6f76df2d709b admin admin] PATH_INFO: `/v3/projects/d99a6eb193bd41428c297fd4b90b9d66` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:00.331882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b9d66-8394-4fb7-8364-6f76df2d709b admin admin] RBAC: Authorizing `identity:get_project(project_id=d99a6eb193bd41428c297fd4b90b9d66)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:00.384834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING keystone.common.rbac_enforcer.enforcer [None req-da4b9d66-8394-4fb7-8364-6f76df2d709b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 19:58:00.385374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b9d66-8394-4fb7-8364-6f76df2d709b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:00.389702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu May 26 19:58:00 2022] GET /identity/v3/projects/d99a6eb193bd41428c297fd4b90b9d66 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:02.560343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714eb59-e21c-4848-97f0-9da8cb4063cb None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:02.560889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714eb59-e21c-4848-97f0-9da8cb4063cb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:02.560978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5714eb59-e21c-4848-97f0-9da8cb4063cb None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:02.565043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:02.570577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6107-bcfe-4c81-8a81-ff1121d84bc1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:02.571038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6107-bcfe-4c81-8a81-ff1121d84bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:02.571434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae6107-bcfe-4c81-8a81-ff1121d84bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:02.589832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-aeae6107-bcfe-4c81-8a81-ff1121d84bc1 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:02.591401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-aeae6107-bcfe-4c81-8a81-ff1121d84bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:02.599105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 19:58:02.621642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714eb59-e21c-4848-97f0-9da8cb4063cb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:02.633688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5714eb59-e21c-4848-97f0-9da8cb4063cb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:02.637843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c81d69-5e23-48f9-804c-f2e5581630fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:02.638473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81d69-5e23-48f9-804c-f2e5581630fb admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:02.638759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81d69-5e23-48f9-804c-f2e5581630fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:02.639066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c81d69-5e23-48f9-804c-f2e5581630fb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:02.646660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c81d69-5e23-48f9-804c-f2e5581630fb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:02.648458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c81d69-5e23-48f9-804c-f2e5581630fb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:02.657068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu May 26 19:58:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:58:02.662531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6107-bcfe-4c81-8a81-ff1121d84bc1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:02.671973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae6107-bcfe-4c81-8a81-ff1121d84bc1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:02.676354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65747c54-ed2f-4d88-8024-bb8895b48838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:02.677203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747c54-ed2f-4d88-8024-bb8895b48838 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:02.677485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747c54-ed2f-4d88-8024-bb8895b48838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:02.677755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65747c54-ed2f-4d88-8024-bb8895b48838 admin admin] PATH_INFO: `/v3/users/561da2b4baef46ee96092703640e527b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:02.679185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65747c54-ed2f-4d88-8024-bb8895b48838 admin admin] RBAC: Authorizing `identity:get_user(user_id=561da2b4baef46ee96092703640e527b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:02.680994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65747c54-ed2f-4d88-8024-bb8895b48838 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:02.683158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu May 26 19:58:02 2022] GET /identity/v3/users/561da2b4baef46ee96092703640e527b => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:04.961808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ae174-41e4-4239-883c-98368d8acd6f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:04.962310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ae174-41e4-4239-883c-98368d8acd6f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:04.962310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ae174-41e4-4239-883c-98368d8acd6f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:04.963793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:04.969125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d945-3d3f-42d1-be30-dbf340be1195 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:04.969554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d945-3d3f-42d1-be30-dbf340be1195 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:04.969690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0091d945-3d3f-42d1-be30-dbf340be1195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:04.986486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0091d945-3d3f-42d1-be30-dbf340be1195 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:04.987676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0091d945-3d3f-42d1-be30-dbf340be1195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:05.001843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2ff0-509e-4e15-bc5a-311e082c2a99 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.002138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2ff0-509e-4e15-bc5a-311e082c2a99 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.002424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2ff0-509e-4e15-bc5a-311e082c2a99 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.003805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:05.009240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.009539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.009820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.049604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG passlib.handlers.bcrypt [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80412) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 19:58:05.050033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG passlib.handlers.bcrypt [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80412) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 19:58:05.066666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:05.089961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091d945-3d3f-42d1-be30-dbf340be1195 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.096635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:05.098303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:05.113057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:05.192165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0091d945-3d3f-42d1-be30-dbf340be1195 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.197539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:05.219696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.227339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.228739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.229030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.229310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.240662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:05.252143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:05.253294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:05.254136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:05.259135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.433218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc6d270-9c76-4730-b3d0-5a6c13d4ca58 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.435615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:05.455835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:05.471684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.472523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.472814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.473097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.474966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084ac1-84f6-49ce-9090-c470680a51cd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.507781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.508445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.508733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.509010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.510286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:05.510593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:05.512034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:05.523581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:05.529699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.540322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:05.541851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:05.629353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77c831-e9d7-4a4c-bfb8-bcf4f954a61c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.643479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:58:05.648914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.652332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:05.665370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.666271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.666559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.666852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] PATH_INFO: `/v3/users/561da2b4baef46ee96092703640e527b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.668141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] RBAC: Authorizing `identity:get_user(user_id=561da2b4baef46ee96092703640e527b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:05.669616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:05.671307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/users/561da2b4baef46ee96092703640e527b => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:05.676539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.691702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:05.750859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee31f3-470d-4803-8b40-53c763db6205 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.779673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30825042-edd2-4359-8122-1b5fb04cf2fc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.797708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.797708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.797708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.797708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.816409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.817211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.817397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:05.817528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.817762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.818993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:05.819145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:05.820451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:05.822968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:05.828885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:58:05.840756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:05.841725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:05.847256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:58:05.847256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:58:05.847256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:58:05.847256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:05.847256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:05.847522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:05.904242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:05.908165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:05.926619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc4eb4-3c7c-49cf-b6b2-85520629c15f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.948898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945c7ef-0b67-4a15-a147-2efac28bf69b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:05.961260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23233299-e4c5-40ff-bd5b-2ff507c35b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.961918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233299-e4c5-40ff-bd5b-2ff507c35b57 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.962201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233299-e4c5-40ff-bd5b-2ff507c35b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.962517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23233299-e4c5-40ff-bd5b-2ff507c35b57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.963396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23233299-e4c5-40ff-bd5b-2ff507c35b57 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.domain.id=default, user.id=561da2b4baef46ee96092703640e527b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:05.963708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23233299-e4c5-40ff-bd5b-2ff507c35b57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:05.965160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23233299-e4c5-40ff-bd5b-2ff507c35b57 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:05.971757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/role_assignments?user.id=561da2b4baef46ee96092703640e527b&scope.domain.id=default&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:05.983048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caf86d6-47e0-4633-af70-8bd10aed42e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:05.983748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf86d6-47e0-4633-af70-8bd10aed42e4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:05.984033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf86d6-47e0-4633-af70-8bd10aed42e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:05.984312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caf86d6-47e0-4633-af70-8bd10aed42e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:05.985066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf86d6-47e0-4633-af70-8bd10aed42e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:05.985377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf86d6-47e0-4633-af70-8bd10aed42e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:05.986827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caf86d6-47e0-4633-af70-8bd10aed42e4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:06.007142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:08.490681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7468f5-5173-4356-8025-223bc6aaa558 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:08.491756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7468f5-5173-4356-8025-223bc6aaa558 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:08.492272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7468f5-5173-4356-8025-223bc6aaa558 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:08.493874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:08.508875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb790-d1ee-4187-90b4-ed15ecf9defe None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:08.510361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb790-d1ee-4187-90b4-ed15ecf9defe None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:08.510879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bb790-d1ee-4187-90b4-ed15ecf9defe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:08.536009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-016bb790-d1ee-4187-90b4-ed15ecf9defe None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:08.537598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-016bb790-d1ee-4187-90b4-ed15ecf9defe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:08.626987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:08.661613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7468f5-5173-4356-8025-223bc6aaa558 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:08.755614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8b13-8364-4dc3-87df-7a1d5a850c67 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:08.756234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8b13-8364-4dc3-87df-7a1d5a850c67 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:08.756715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be8b13-8364-4dc3-87df-7a1d5a850c67 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:08.758553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 12/24] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:08.764791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff487-bd16-4015-ad30-2cc7467ec288 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:08.765354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff487-bd16-4015-ad30-2cc7467ec288 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:08.765836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff487-bd16-4015-ad30-2cc7467ec288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:08.791661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-182ff487-bd16-4015-ad30-2cc7467ec288 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:08.793321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-182ff487-bd16-4015-ad30-2cc7467ec288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:08.814812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7468f5-5173-4356-8025-223bc6aaa558 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:08.877036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:08.884910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:08.886467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:08.886756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:08.887055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:08.918103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:08.926594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:08.927528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:08.928274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:08.937007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 13/25] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:08.942701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:08.951420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:08.952349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:08.999286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ff487-bd16-4015-ad30-2cc7467ec288 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:09.117118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aafbc5-5bdc-4b1f-8954-fa398ade1c8c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:09.166209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811105-1ae2-4b8f-88da-ab645b86c65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:09.166932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811105-1ae2-4b8f-88da-ab645b86c65b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.167185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811105-1ae2-4b8f-88da-ab645b86c65b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.167457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811105-1ae2-4b8f-88da-ab645b86c65b None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.168213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811105-1ae2-4b8f-88da-ab645b86c65b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:09.168521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811105-1ae2-4b8f-88da-ab645b86c65b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:09.169921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811105-1ae2-4b8f-88da-ab645b86c65b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:09.185074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 14/27] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:09.186408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f2e4b-d271-4734-b841-d7c45af76525 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.186697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f2e4b-d271-4734-b841-d7c45af76525 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.187007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f2e4b-d271-4734-b841-d7c45af76525 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.189675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 15/28] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:09.197355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f2e4b-d271-4734-b841-d7c45af76525 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:09.199841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ff487-bd16-4015-ad30-2cc7467ec288 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:09.248150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaaf48d-9c44-40eb-89fa-9df2d9fa98ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:09.249201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaf48d-9c44-40eb-89fa-9df2d9fa98ff None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.249810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaf48d-9c44-40eb-89fa-9df2d9fa98ff None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.250290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaaf48d-9c44-40eb-89fa-9df2d9fa98ff None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.251279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaaf48d-9c44-40eb-89fa-9df2d9fa98ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:09.253228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaaf48d-9c44-40eb-89fa-9df2d9fa98ff None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:09.274562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:09.315575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f2e4b-d271-4734-b841-d7c45af76525 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:09.354645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78df65-f19f-40de-a31e-42134a439571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:09.355549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78df65-f19f-40de-a31e-42134a439571 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.355832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78df65-f19f-40de-a31e-42134a439571 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.356106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78df65-f19f-40de-a31e-42134a439571 None admin] PATH_INFO: `/v3/users/561da2b4baef46ee96092703640e527b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.357362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78df65-f19f-40de-a31e-42134a439571 None admin] RBAC: Authorizing `identity:get_user(user_id=561da2b4baef46ee96092703640e527b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:09.359027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d78df65-f19f-40de-a31e-42134a439571 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:09.360986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 16/29] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:09 2022] GET /identity/v3/users/561da2b4baef46ee96092703640e527b => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:09.362327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3d9d-6a6a-4939-9294-e6b3614c466e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.362621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3d9d-6a6a-4939-9294-e6b3614c466e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.362931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3d9d-6a6a-4939-9294-e6b3614c466e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.380935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-765c3d9d-6a6a-4939-9294-e6b3614c466e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:09.382134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-765c3d9d-6a6a-4939-9294-e6b3614c466e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:09.415997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 14/30] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 19:58:08 2022] POST /identity/v3/roles => generated 219 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:58:09.418272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c50e22-23db-41b1-84c1-fb6ce372b65b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.418885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c50e22-23db-41b1-84c1-fb6ce372b65b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.419387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c50e22-23db-41b1-84c1-fb6ce372b65b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.420951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 15/31] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:09.426449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c50e22-23db-41b1-84c1-fb6ce372b65b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:09.477390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:09.482512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 17/32] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:09.484244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f803f3-fbf6-4d1a-ada6-780e49245587 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.484746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f803f3-fbf6-4d1a-ada6-780e49245587 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.485201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f803f3-fbf6-4d1a-ada6-780e49245587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.524154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-43f803f3-fbf6-4d1a-ada6-780e49245587 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:09.526691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-43f803f3-fbf6-4d1a-ada6-780e49245587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:09.556556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c50e22-23db-41b1-84c1-fb6ce372b65b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:09.601505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:09.602442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.602748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.603665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.612577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:09.617238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:09.634282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 16/33] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:09.636415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:09.689780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:09.701932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 18/34] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:09.702297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f803f3-fbf6-4d1a-ada6-780e49245587 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:09.772352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80f635-8a40-4d7a-b7e9-86c32a00a98d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:09.776119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:09.811889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:09.812697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.812981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.813266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.826967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:09.828463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:09.851745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f803f3-fbf6-4d1a-ada6-780e49245587 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:58:09.852065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:09.852825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:09.854251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:58:09.854251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:58:09.854251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:58:09.854251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:09.854450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 17/35] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:09.856902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:09.907659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf163b-9503-40b5-bb0b-694f36e93a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:09.908474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf163b-9503-40b5-bb0b-694f36e93a6d None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:09.908759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf163b-9503-40b5-bb0b-694f36e93a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:09.909035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf163b-9503-40b5-bb0b-694f36e93a6d None admin] PATH_INFO: `/v3/domains/default/users/561da2b4baef46ee96092703640e527b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:09.911150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf163b-9503-40b5-bb0b-694f36e93a6d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=561da2b4baef46ee96092703640e527b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:09.913133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf163b-9503-40b5-bb0b-694f36e93a6d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:09.986767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e037af3-a8a3-45b5-b6a6-07e3815e0681 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:10.028511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:10.029217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.029506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.029835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.030759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:10.032235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:10.049168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 18/36] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 19:58:09 2022] POST /identity/v3/roles => generated 225 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:10.054308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 19/37] 10.222.0.48 () {58 vars in 1361 bytes} [Thu May 26 19:58:09 2022] PUT /identity/v3/domains/default/users/561da2b4baef46ee96092703640e527b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:10.055143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:10.094262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:10.178536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f783f-e7be-499f-bf49-3917fc6a9a24 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.178820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f783f-e7be-499f-bf49-3917fc6a9a24 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.179048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987f783f-e7be-499f-bf49-3917fc6a9a24 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.184443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 20/38] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:10.192427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c556674-8b93-4e93-b7ce-1621ea2a2aab None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.193949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c556674-8b93-4e93-b7ce-1621ea2a2aab None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.194540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c556674-8b93-4e93-b7ce-1621ea2a2aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.228479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8c556674-8b93-4e93-b7ce-1621ea2a2aab None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:10.232361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8c556674-8b93-4e93-b7ce-1621ea2a2aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:10.243158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1b332-7f70-48af-b19c-15af35aa703a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:10.295411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:10.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.295952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.296237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.297019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:10.297332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:10.298736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:10.312273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:10.314233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 19/39] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:10.320247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:10.336250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 21/40] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:10.337798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde3e14-fdd4-48ed-bb0b-7c6d08b454e1 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.338102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde3e14-fdd4-48ed-bb0b-7c6d08b454e1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.338391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde3e14-fdd4-48ed-bb0b-7c6d08b454e1 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.339997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 22/41] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:10.345078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f37b-8c70-4663-911a-ff7e13d45f8f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.345375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f37b-8c70-4663-911a-ff7e13d45f8f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.345659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af7f37b-8c70-4663-911a-ff7e13d45f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.364534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4af7f37b-8c70-4663-911a-ff7e13d45f8f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:10.365744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4af7f37b-8c70-4663-911a-ff7e13d45f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:10.412664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:10.437341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5cf2a-e118-425f-860a-a8f29b102da3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:10.437496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 23/42] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:10.438086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7f37b-8c70-4663-911a-ff7e13d45f8f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:10.481788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:10.482460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.482750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.483083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.483814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:10.485249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:10.515122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 20/43] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 19:58:10 2022] POST /identity/v3/projects => generated 301 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:10.515940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:10.579913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af7f37b-8c70-4663-911a-ff7e13d45f8f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:10.603490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:10.636227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:10.637382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.637849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.638305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.640464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:10.642500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:10.645546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 24/44] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:10.651247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:10.657192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b04b8-51c2-4150-b86e-775041fcdc7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:10.708718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:10.724269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09116dd8-adb7-4075-97a1-c6fe0fa3e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:10.725393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09116dd8-adb7-4075-97a1-c6fe0fa3e139 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.725903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09116dd8-adb7-4075-97a1-c6fe0fa3e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.726351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09116dd8-adb7-4075-97a1-c6fe0fa3e139 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.731375 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09116dd8-adb7-4075-97a1-c6fe0fa3e139 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:10.734101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09116dd8-adb7-4075-97a1-c6fe0fa3e139 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:10.750642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 21/45] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 19:58:10 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:10.788512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8657bd-d46d-45c2-ba98-60f5d9a639f0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:10.831443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b1355-bf74-4eea-8718-a18fafff1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:10.832236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b1355-bf74-4eea-8718-a18fafff1357 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:10.832586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b1355-bf74-4eea-8718-a18fafff1357 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:10.832881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b1355-bf74-4eea-8718-a18fafff1357 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:10.833719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b1355-bf74-4eea-8718-a18fafff1357 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:10.835282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b1355-bf74-4eea-8718-a18fafff1357 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:10.873312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 25/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 19:58:10 2022] POST /identity/v3/projects => generated 312 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:58:12.393670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518511fc-c2e7-40f3-a382-1dd0b370fef0 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:12.394190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518511fc-c2e7-40f3-a382-1dd0b370fef0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:12.394273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518511fc-c2e7-40f3-a382-1dd0b370fef0 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:12.395649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 22/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:12.401006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd074d5-49e2-4ddb-877d-05ca05242676 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:12.401405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd074d5-49e2-4ddb-877d-05ca05242676 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:12.401582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd074d5-49e2-4ddb-877d-05ca05242676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:12.418713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4bd074d5-49e2-4ddb-877d-05ca05242676 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:12.419939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4bd074d5-49e2-4ddb-877d-05ca05242676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:12.446395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:12.486328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 26/48] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:12.509473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518511fc-c2e7-40f3-a382-1dd0b370fef0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:12.611379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518511fc-c2e7-40f3-a382-1dd0b370fef0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:12.645540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:12.646289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:12.646579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:12.646885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:12.659090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:12.668648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:12.669479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:12.670236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 23/49] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:12.675634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd074d5-49e2-4ddb-877d-05ca05242676 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:12.770530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd074d5-49e2-4ddb-877d-05ca05242676 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:12.803640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:12.804383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:12.804676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:12.804958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:12.805715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:12.806054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:12.807504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:12.815515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 27/50] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:12.821293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:12.873996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:12.929756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33061950-38e6-408a-93cc-89efd8c9840c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:12.964273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6752b5d-a5b2-40f4-989f-c1818bbbe019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:12.965204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752b5d-a5b2-40f4-989f-c1818bbbe019 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:12.965447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752b5d-a5b2-40f4-989f-c1818bbbe019 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:12.965730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6752b5d-a5b2-40f4-989f-c1818bbbe019 None admin] PATH_INFO: `/v3/users/561da2b4baef46ee96092703640e527b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:12.967206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752b5d-a5b2-40f4-989f-c1818bbbe019 None admin] RBAC: Authorizing `identity:get_user(user_id=561da2b4baef46ee96092703640e527b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:12.968675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6752b5d-a5b2-40f4-989f-c1818bbbe019 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:12.971215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:12 2022] GET /identity/v3/users/561da2b4baef46ee96092703640e527b => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:12.976396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:13.003491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:13.075858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f162e607-5de6-473d-a629-ecbd487e8682 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:13.089504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34e5d-d285-42ae-ad90-319b8de92378 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:13.089804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34e5d-d285-42ae-ad90-319b8de92378 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:13.090087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa34e5d-d285-42ae-ad90-319b8de92378 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:13.091482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 25/52] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:13.096284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e132854-34eb-484b-88c4-0a9727bcedf6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:13.096579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e132854-34eb-484b-88c4-0a9727bcedf6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:13.096862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e132854-34eb-484b-88c4-0a9727bcedf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:13.109230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:13.110029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:13.110312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:13.110589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:13.111794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:13.113251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:13.113361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7e132854-34eb-484b-88c4-0a9727bcedf6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:13.114881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 28/53] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:13.115066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7e132854-34eb-484b-88c4-0a9727bcedf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:13.120465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:13.182997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 26/54] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:13.205987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e132854-34eb-484b-88c4-0a9727bcedf6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:13.212205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:13.220174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc896e1-5459-4344-958e-661d062d891a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:13.251543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:13.252485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:13.253276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:13.253656 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:13.254102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:13.254909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.domain.id=default, user.id=561da2b4baef46ee96092703640e527b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:13.255224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:13.256682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:13.263249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 29/55] 10.222.0.48 () {56 vars in 1322 bytes} [Thu May 26 19:58:13 2022] GET /identity/v3/role_assignments?user.id=561da2b4baef46ee96092703640e527b&scope.domain.id=default&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:13.307601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e132854-34eb-484b-88c4-0a9727bcedf6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:13.347789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7785b-defc-4b48-b5e4-4bde7921543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:13.348605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7785b-defc-4b48-b5e4-4bde7921543b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:13.348892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7785b-defc-4b48-b5e4-4bde7921543b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:13.349172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7785b-defc-4b48-b5e4-4bde7921543b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:13.350408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7785b-defc-4b48-b5e4-4bde7921543b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:13.351921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7785b-defc-4b48-b5e4-4bde7921543b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:13.353750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 27/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:13.359429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:13.466484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b3f30-78de-4743-82ee-cbf28d307010 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:13.501354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33254c78-23ca-4821-83b0-b31717cc726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:13.502032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254c78-23ca-4821-83b0-b31717cc726b None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:13.502318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254c78-23ca-4821-83b0-b31717cc726b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:13.502594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33254c78-23ca-4821-83b0-b31717cc726b None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:13.503383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254c78-23ca-4821-83b0-b31717cc726b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:13.504840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33254c78-23ca-4821-83b0-b31717cc726b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:13.530234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 30/57] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 26 19:58:13 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:15.727259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040197-c169-4f7b-8c1d-f384b38b2b57 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:15.727789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040197-c169-4f7b-8c1d-f384b38b2b57 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:15.728431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6040197-c169-4f7b-8c1d-f384b38b2b57 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:15.729810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 28/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:15.735067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ea8b-ea43-4d36-baa8-9d620152c44a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:15.735442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ea8b-ea43-4d36-baa8-9d620152c44a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:15.735641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9ea8b-ea43-4d36-baa8-9d620152c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:15.751890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a4c9ea8b-ea43-4d36-baa8-9d620152c44a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:15.753088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a4c9ea8b-ea43-4d36-baa8-9d620152c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:15.755774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:15.818344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 31/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:15.842981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040197-c169-4f7b-8c1d-f384b38b2b57 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:15.940452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6040197-c169-4f7b-8c1d-f384b38b2b57 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:15.954729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:15.975136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c909a-215f-40af-bdc9-5f2e2dc71b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:15.975930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c909a-215f-40af-bdc9-5f2e2dc71b05 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:15.976219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c909a-215f-40af-bdc9-5f2e2dc71b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:15.976499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c909a-215f-40af-bdc9-5f2e2dc71b05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:15.977671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c909a-215f-40af-bdc9-5f2e2dc71b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:15.979162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c909a-215f-40af-bdc9-5f2e2dc71b05 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:15.980760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 29/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:15.986301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ea8b-ea43-4d36-baa8-9d620152c44a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:16.080837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9ea8b-ea43-4d36-baa8-9d620152c44a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:16.112795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9364fa9-70ab-4bf1-b344-0faa6b25eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:16.113446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364fa9-70ab-4bf1-b344-0faa6b25eb61 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:16.113729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364fa9-70ab-4bf1-b344-0faa6b25eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:16.114005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364fa9-70ab-4bf1-b344-0faa6b25eb61 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:16.114714 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9364fa9-70ab-4bf1-b344-0faa6b25eb61 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:16.116189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9364fa9-70ab-4bf1-b344-0faa6b25eb61 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:16.131050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:16.142622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 32/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:58:15 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:19.458527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62204fe-5530-4d60-a1b6-32288d0125d0 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:19.459728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62204fe-5530-4d60-a1b6-32288d0125d0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:19.460216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62204fe-5530-4d60-a1b6-32288d0125d0 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:19.461799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 30/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:19.467461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e284-0291-4334-9dab-8e3c9002bc7c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:19.467915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e284-0291-4334-9dab-8e3c9002bc7c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:19.468021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433e284-0291-4334-9dab-8e3c9002bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:19.491789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0433e284-0291-4334-9dab-8e3c9002bc7c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:19.493783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0433e284-0291-4334-9dab-8e3c9002bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:19.585153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 33/63] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:19.609085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b4330-be05-4954-b984-39ad8743c8af None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:19.609703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b4330-be05-4954-b984-39ad8743c8af None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:19.610186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b4330-be05-4954-b984-39ad8743c8af None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:19.611796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:19.617316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c715b-7af3-4e60-972a-032f687bf1a9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:19.617588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c715b-7af3-4e60-972a-032f687bf1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:19.617869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c715b-7af3-4e60-972a-032f687bf1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:19.619226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b4330-be05-4954-b984-39ad8743c8af None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:19.645231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f99c715b-7af3-4e60-972a-032f687bf1a9 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:19.647880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f99c715b-7af3-4e60-972a-032f687bf1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:19.791582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b4330-be05-4954-b984-39ad8743c8af None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:19.807020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 34/65] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:19.833656 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c715b-7af3-4e60-972a-032f687bf1a9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:19.872940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:19.873754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:19.874042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:19.874320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:19.900054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:19.909593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:19.910486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:19.911702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 32/66] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:19.915734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:19.920169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:19.964219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c715b-7af3-4e60-972a-032f687bf1a9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:19.981768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.003640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08332fc9-c749-4f43-9c0e-f1f66464ba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.004728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08332fc9-c749-4f43-9c0e-f1f66464ba5f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.005200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08332fc9-c749-4f43-9c0e-f1f66464ba5f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.005630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08332fc9-c749-4f43-9c0e-f1f66464ba5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.019354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08332fc9-c749-4f43-9c0e-f1f66464ba5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-08332fc9-c749-4f43-9c0e-f1f66464ba5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:20.027914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:20.028832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:20.029572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 35/67] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:20.030663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d4ee-03a5-40df-a77b-23e84cb79a59 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.030816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d4ee-03a5-40df-a77b-23e84cb79a59 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.031144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607d4ee-03a5-40df-a77b-23e84cb79a59 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.032522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 36/68] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:20.033458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af0e0-d9c6-4616-b440-f6719da78108 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.037480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af0e0-d9c6-4616-b440-f6719da78108 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.037480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26af0e0-d9c6-4616-b440-f6719da78108 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.037480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 37/69] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:20.037480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26af0e0-d9c6-4616-b440-f6719da78108 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.056811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19840317-a597-4ac5-8566-f4db4aadf6ef None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.091407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ce9c-25b2-48d3-a225-f127c4261bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.092084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ce9c-25b2-48d3-a225-f127c4261bef None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.092374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ce9c-25b2-48d3-a225-f127c4261bef None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.092655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ce9c-25b2-48d3-a225-f127c4261bef None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.093427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ce9c-25b2-48d3-a225-f127c4261bef None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:20.093719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ce9c-25b2-48d3-a225-f127c4261bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:20.095119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ce9c-25b2-48d3-a225-f127c4261bef None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:20.107936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 33/70] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:20.109305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0bbd6-dd82-4ea7-824e-58a52672b5db None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.109608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0bbd6-dd82-4ea7-824e-58a52672b5db None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.109891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0bbd6-dd82-4ea7-824e-58a52672b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.127464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2de0bbd6-dd82-4ea7-824e-58a52672b5db None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:20.128671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2de0bbd6-dd82-4ea7-824e-58a52672b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:20.153143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26af0e0-d9c6-4616-b440-f6719da78108 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.170980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.190862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.191549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.191832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.192106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.192851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:20.193160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:20.194545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:20.197869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 34/71] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:20.199280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e8ab-af6e-458f-a092-fc75491f8e06 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.199572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e8ab-af6e-458f-a092-fc75491f8e06 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.199864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7e8ab-af6e-458f-a092-fc75491f8e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.206876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 38/72] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:20.206876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.224455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-76e7e8ab-af6e-458f-a092-fc75491f8e06 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:20.225652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-76e7e8ab-af6e-458f-a092-fc75491f8e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:20.252200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.292626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 35/73] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:20.294250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ad60a-7779-4f0f-9589-26a3112099f0 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.294550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ad60a-7779-4f0f-9589-26a3112099f0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.294858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ad60a-7779-4f0f-9589-26a3112099f0 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.296153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 36/74] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:20.296861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ad60a-7779-4f0f-9589-26a3112099f0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.313824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1082526-d344-4dde-8c8e-68bb48559e20 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.349869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.350767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.351064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.351349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.365874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:20.367478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:20.369123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 39/75] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:20.369890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.405137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ad60a-7779-4f0f-9589-26a3112099f0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.407003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.438090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed91ec6-234f-4390-a8b9-595b1de30b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.438995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed91ec6-234f-4390-a8b9-595b1de30b02 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.439286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed91ec6-234f-4390-a8b9-595b1de30b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.439572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed91ec6-234f-4390-a8b9-595b1de30b02 None admin] PATH_INFO: `/v3/users/561da2b4baef46ee96092703640e527b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.440773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed91ec6-234f-4390-a8b9-595b1de30b02 None admin] RBAC: Authorizing `identity:get_user(user_id=561da2b4baef46ee96092703640e527b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:20.442240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed91ec6-234f-4390-a8b9-595b1de30b02 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:20.444049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 37/76] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/users/561da2b4baef46ee96092703640e527b => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:20.445188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aaaa1-af33-4597-8ace-b17138a98ee5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.445485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aaaa1-af33-4597-8ace-b17138a98ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.445770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8aaaa1-af33-4597-8ace-b17138a98ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.463046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3c8aaaa1-af33-4597-8ace-b17138a98ee5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:20.464243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3c8aaaa1-af33-4597-8ace-b17138a98ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:20.473333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4d40b-8391-4ece-bdfe-1c250392a5d3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.489331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.505781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.506585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.506897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.507178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.517979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:20.526721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:20.527605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:20.528363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 40/77] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:20.529065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.531829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 38/78] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:20.532686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aaaa1-af33-4597-8ace-b17138a98ee5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.626502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.632837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eca7c6-ac93-4e46-b269-60aa1b6ee60f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.635692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8aaaa1-af33-4597-8ace-b17138a98ee5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.666513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.667343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.667635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.667917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.669237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.669884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.670169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.670451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.677797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:20.685698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:20.686728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 41/79] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:20.692325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.707470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.746180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:20.747688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:20.785889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf30a8-ff98-4a85-b5e9-11b7a67b2255 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.818935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.819583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.819870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.820150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.844905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 39/80] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:20.845383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.845929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.896440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:20.897848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:20.905793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:20.944366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7bf0ac-fe5b-47d0-83ca-09b89d55977f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:20.979075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:20.979741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:20.980028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:20.980307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:20.981054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:20.981366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:20.982744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:20.990730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:20.991383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:20.998279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 42/82] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:20.999335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.056991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.092261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af1bd-c029-43a0-a9a6-00a89caf5e37 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.101448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c705850a-1bb0-42fa-9f24-be41c2471175 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.114092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.125373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.126174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.126454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.126828 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.127935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.129375 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.131036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 41/83] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.131746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.135427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.136360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.136649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.136928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.137682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:21.137987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.139384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.151691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 43/84] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.151691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.230412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d344b44-e7c2-4308-8fd9-b89146e99739 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.246153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda9691-1bbd-44a0-abd5-5c69fe6f5587 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.263214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.263799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.264745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.265107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.265392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.266634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.268169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.269954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 42/85] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.270560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.281133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.282008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.282295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.282577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.283799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.285228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.291106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 44/86] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.291106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.333135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.375970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afcdd3b-190a-4c8c-88cf-29f5c58826e9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.391345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfe04f-404a-4a16-b517-1e14df9e3727 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.410632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.411468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.411761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.412047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.413252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.414716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.416477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 43/87] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.417240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.429789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.430465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.430802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.431115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.431826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.433287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.453910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 45/88] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:58:21 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:21.453910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.503073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.530505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d326ef-0d22-4f46-bb4a-b782fa191dc3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.560811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.570182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.572026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.572328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.572598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.573867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.574443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50226b8-8905-4856-926b-81d47fb87089 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.575383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.577346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 44/89] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.578234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.614210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.615344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.615796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.616088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.616959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=ba19132a5049407ea836cbcaf73d3258) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:21.617288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.619448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.628910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 46/90] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/role_assignments?user.id=ba19132a5049407ea836cbcaf73d3258&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=2f1a975d114c4307b75105be01055d98 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.640839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.717283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca731c6-572f-4ad8-b582-8411dc08779c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.762613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.763321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.763609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.763891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.790942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f051-08d6-48d7-8fcb-64fd9dcf041b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:21.799197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.841779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:21.842452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:21.842756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:21.843046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:21.843954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=561da2b4baef46ee96092703640e527b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:21.844275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.845735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:21.853897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 47/91] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/role_assignments?user.id=561da2b4baef46ee96092703640e527b&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:21.854735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:21.860016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:21.869477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:21.871903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:22.032252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be681a7c-d672-48bf-9830-ffbd3c1c3ced None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:22.063806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 45/92] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:22.070180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:22.127147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:22.127823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:22.128111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:22.128395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:22.209760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:22.248625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:22.255473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010c04e3-a858-42da-a055-d33637d017bb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:22.283996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:22.285407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:22.293100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:22.293970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:22.294261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:22.294543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:22.295794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:22.297239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:22.298988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 46/93] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:22 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:22.304667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:22.413902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba06f-5096-4c38-a3d3-288498a3f920 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:22.452356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:22.453031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:22.453319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:22.453602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:22.454448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] RBAC: Adding query filter params (role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=ba19132a5049407ea836cbcaf73d3258) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:22.454765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:22.456269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:22.465965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 47/94] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:22 2022] GET /identity/v3/role_assignments?user.id=ba19132a5049407ea836cbcaf73d3258&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:22.517732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 48/95] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:22.524183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:22.572310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:22.672242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419acca2-f220-4a8e-b3cc-96102f3cb7e8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:22.710205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbf4fa-d089-4a1b-b663-4de52e8be4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:22.711119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf4fa-d089-4a1b-b663-4de52e8be4bf None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:22.711474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf4fa-d089-4a1b-b663-4de52e8be4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:22.711759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbf4fa-d089-4a1b-b663-4de52e8be4bf None admin] PATH_INFO: `/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:22.713060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbf4fa-d089-4a1b-b663-4de52e8be4bf None admin] RBAC: Authorizing `identity:get_project(project_id=fbdbf3efee5a4a518dffdc77eb76e4df)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:22.714599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbf4fa-d089-4a1b-b663-4de52e8be4bf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:22.716727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 48/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:22 2022] GET /identity/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:22.722450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:22.839354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:22.879664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a21df0-830e-4ee5-ac79-c7156c3777ad None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:22.933357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2757d37-a4b9-464c-8e85-51c23b8dae17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:22.934084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2757d37-a4b9-464c-8e85-51c23b8dae17 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:22.934376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2757d37-a4b9-464c-8e85-51c23b8dae17 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:22.934710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2757d37-a4b9-464c-8e85-51c23b8dae17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:22.935588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2757d37-a4b9-464c-8e85-51c23b8dae17 None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=fbdbf3efee5a4a518dffdc77eb76e4df, user.id=ba19132a5049407ea836cbcaf73d3258) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:22.935961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2757d37-a4b9-464c-8e85-51c23b8dae17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:22.937486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2757d37-a4b9-464c-8e85-51c23b8dae17 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:22.947477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 49/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:22 2022] GET /identity/v3/role_assignments?user.id=ba19132a5049407ea836cbcaf73d3258&scope.project.id=fbdbf3efee5a4a518dffdc77eb76e4df&role.id=2f1a975d114c4307b75105be01055d98 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:24.622194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822174b0-fecd-4ca6-9b8a-2dc34760ccd3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:24.622747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822174b0-fecd-4ca6-9b8a-2dc34760ccd3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:24.622747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822174b0-fecd-4ca6-9b8a-2dc34760ccd3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:24.624320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 49/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:24.636607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835a0b2-486d-4bff-8a70-288c58e2ee18 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:24.637025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835a0b2-486d-4bff-8a70-288c58e2ee18 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:24.637191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835a0b2-486d-4bff-8a70-288c58e2ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:24.655349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e835a0b2-486d-4bff-8a70-288c58e2ee18 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:24.656571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e835a0b2-486d-4bff-8a70-288c58e2ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:24.730514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 50/99] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:24.752262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822174b0-fecd-4ca6-9b8a-2dc34760ccd3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:24.761926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9dbdc-d7d6-4a46-8880-6fb929a564ef None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:24.761926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9dbdc-d7d6-4a46-8880-6fb929a564ef None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:24.761926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9dbdc-d7d6-4a46-8880-6fb929a564ef None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:24.761926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 51/100] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:24.767701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6858-1c5f-4401-9faf-e83f0723ea79 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:24.767992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6858-1c5f-4401-9faf-e83f0723ea79 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:24.768280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b6858-1c5f-4401-9faf-e83f0723ea79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:24.786095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-af3b6858-1c5f-4401-9faf-e83f0723ea79 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:24.787573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-af3b6858-1c5f-4401-9faf-e83f0723ea79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:24.896532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:24.905749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 52/101] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:24.937710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:24.944188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6858-1c5f-4401-9faf-e83f0723ea79 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:24.967292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822174b0-fecd-4ca6-9b8a-2dc34760ccd3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.022770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ceadb-6ef5-4ea1-ae23-6beef5e597f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.023620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceadb-6ef5-4ea1-ae23-6beef5e597f5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.023943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceadb-6ef5-4ea1-ae23-6beef5e597f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.024225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ceadb-6ef5-4ea1-ae23-6beef5e597f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.044142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6ceadb-6ef5-4ea1-ae23-6beef5e597f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9a6ceadb-6ef5-4ea1-ae23-6beef5e597f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:25.055547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:25.056495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:25.057279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:25.058443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 50/102] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:25.059564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d574-5971-4d32-80d7-24f34745fd96 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.061939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d574-5971-4d32-80d7-24f34745fd96 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.061939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834d574-5971-4d32-80d7-24f34745fd96 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.061939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 51/103] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:25.062399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3b6858-1c5f-4401-9faf-e83f0723ea79 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.062868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ab30-6580-4a05-9f3e-f9cdc176570d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.063159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ab30-6580-4a05-9f3e-f9cdc176570d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.063430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ab30-6580-4a05-9f3e-f9cdc176570d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.065985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 52/104] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:25.066923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ab30-6580-4a05-9f3e-f9cdc176570d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.111113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40300cee-c1c1-4dda-9ba1-00a61bd15d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.112031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40300cee-c1c1-4dda-9ba1-00a61bd15d72 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.112383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40300cee-c1c1-4dda-9ba1-00a61bd15d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.112727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40300cee-c1c1-4dda-9ba1-00a61bd15d72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.124120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40300cee-c1c1-4dda-9ba1-00a61bd15d72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-40300cee-c1c1-4dda-9ba1-00a61bd15d72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:25.134534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:25.135428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:25.136181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:25.136764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 53/105] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:25.138457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55346e42-8959-401c-8b4b-038fa831ad08 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.139152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55346e42-8959-401c-8b4b-038fa831ad08 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.139772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55346e42-8959-401c-8b4b-038fa831ad08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.158905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-55346e42-8959-401c-8b4b-038fa831ad08 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:25.160227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-55346e42-8959-401c-8b4b-038fa831ad08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:25.184189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9ab30-6580-4a05-9f3e-f9cdc176570d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.223395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1f974-32e2-498a-b412-e06f878468ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.224080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f974-32e2-498a-b412-e06f878468ac None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.224353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f974-32e2-498a-b412-e06f878468ac None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.224694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:25.225314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1f974-32e2-498a-b412-e06f878468ac None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.226200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f974-32e2-498a-b412-e06f878468ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:25.226524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f974-32e2-498a-b412-e06f878468ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:25.228124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1f974-32e2-498a-b412-e06f878468ac None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:25.238129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 53/106] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:25.239433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498f7b-6e4c-489f-9b96-01cb43b02070 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.239732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498f7b-6e4c-489f-9b96-01cb43b02070 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.240012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b498f7b-6e4c-489f-9b96-01cb43b02070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.245946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 54/107] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:25.247020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55346e42-8959-401c-8b4b-038fa831ad08 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.266562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3b498f7b-6e4c-489f-9b96-01cb43b02070 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:25.271874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3b498f7b-6e4c-489f-9b96-01cb43b02070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:25.293444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:25.356381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 54/108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:25.357659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498f7b-6e4c-489f-9b96-01cb43b02070 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.363999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55346e42-8959-401c-8b4b-038fa831ad08 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.404861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.405542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.405836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.406123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.406931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:25.407253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:25.408782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:25.418030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 55/109] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:25.423305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.461195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b498f7b-6e4c-489f-9b96-01cb43b02070 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.495465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:25.499790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.500714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.500996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.501280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] PATH_INFO: `/v3/users/561da2b4baef46ee96092703640e527b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.502528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] RBAC: Authorizing `identity:get_user(user_id=561da2b4baef46ee96092703640e527b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:25.504103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:25.505770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 55/110] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/users/561da2b4baef46ee96092703640e527b => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:25.506646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.525927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:25.537179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa7cc6-de36-421a-9c31-3e7985fe3b2b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.576175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.577464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.578014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.578514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.580034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:25.582021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:25.584004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 56/111] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:25.585042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.616674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed9937-0beb-409f-95df-1c31ae619c04 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.655720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.656528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.657139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.657425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.672559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:25.683353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:25.684222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:25.684958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 56/112] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:25.685613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.714566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f93a9c-1d2d-45e3-861d-ab30baf90a4a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.731795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:25.754658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.755891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.756375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.756849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.758388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:25.760207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:25.762089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 57/113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:25.763126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.782376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:25.809246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40146d3a-69a3-4d55-ac7d-9e6885674cac None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.848457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.849726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.850227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.850716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.852342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:25.854562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:25.856944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 57/114] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:25.858055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:25.901138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc160a2-e46d-4345-9dea-4fa097f25823 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.945578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:25.946963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:25.947519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:25.948063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:25.948986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:25.950641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:25.974490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b63447-6eb5-4f7f-be21-2862b58d8590 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:25.981831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 58/115] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 19:58:25 2022] POST /identity/v3/projects => generated 302 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:25.987555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:26.042729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:26.043447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.043738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.044019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.045188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:26.045510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:26.047058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:26.063991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 58/116] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:26.064856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:26.070150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:26.082061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:26.148643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e5656-7b5c-4480-ac46-970f76834b47 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:26.199691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2421886-f8c8-4933-8666-019784551409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:26.200851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2421886-f8c8-4933-8666-019784551409 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.201881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2421886-f8c8-4933-8666-019784551409 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.202322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2421886-f8c8-4933-8666-019784551409 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.204083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2421886-f8c8-4933-8666-019784551409 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:26.206260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2421886-f8c8-4933-8666-019784551409 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:26.208258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 59/117] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:25 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:26.208854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2421886-f8c8-4933-8666-019784551409 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:26.220679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a35c1-7e7c-4239-86c3-7dabd141de3a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:26.265819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df235ad-2228-409a-aca0-baaa83eb5073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:26.266733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df235ad-2228-409a-aca0-baaa83eb5073 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.267066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df235ad-2228-409a-aca0-baaa83eb5073 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.267357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df235ad-2228-409a-aca0-baaa83eb5073 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/561da2b4baef46ee96092703640e527b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.269354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df235ad-2228-409a-aca0-baaa83eb5073 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc54ff0c5398464b9c085152fd7db90e, user_id=561da2b4baef46ee96092703640e527b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:26.270822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df235ad-2228-409a-aca0-baaa83eb5073 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:26.285307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 59/118] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:26 2022] PUT /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/561da2b4baef46ee96092703640e527b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:26.286605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7321d-947d-416f-a65e-12d4ca6689d2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.286936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7321d-947d-416f-a65e-12d4ca6689d2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.287227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7321d-947d-416f-a65e-12d4ca6689d2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.293198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 60/119] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:26.293198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7321d-947d-416f-a65e-12d4ca6689d2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:26.340958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2421886-f8c8-4933-8666-019784551409 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:26.343111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:26.382201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5c1a2-8e12-476b-8e4e-146487eaac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:26.383135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5c1a2-8e12-476b-8e4e-146487eaac0c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.383449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5c1a2-8e12-476b-8e4e-146487eaac0c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.384241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5c1a2-8e12-476b-8e4e-146487eaac0c None admin] PATH_INFO: `/v3/users/2e971d629bbb470ca003888d2b41d2d0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.401598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5c1a2-8e12-476b-8e4e-146487eaac0c None admin] RBAC: Authorizing `identity:get_user(user_id=2e971d629bbb470ca003888d2b41d2d0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:26.403150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5c1a2-8e12-476b-8e4e-146487eaac0c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:26.409591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 60/120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:26 2022] GET /identity/v3/users/2e971d629bbb470ca003888d2b41d2d0 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:26.411198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6004-7211-40a0-aed5-3e68ed9a00f9 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.411496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6004-7211-40a0-aed5-3e68ed9a00f9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.411783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6004-7211-40a0-aed5-3e68ed9a00f9 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.413165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 61/121] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:26.414751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0ec02-87d1-4fe2-bc25-de9a78a17e18 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.415613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0ec02-87d1-4fe2-bc25-de9a78a17e18 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.415900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0ec02-87d1-4fe2-bc25-de9a78a17e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.427876 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:26.434957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-58a0ec02-87d1-4fe2-bc25-de9a78a17e18 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:26.435377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7321d-947d-416f-a65e-12d4ca6689d2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:26.436347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-58a0ec02-87d1-4fe2-bc25-de9a78a17e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:26.487609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:26.488568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.488936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.489296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/ba19132a5049407ea836cbcaf73d3258/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.491513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc54ff0c5398464b9c085152fd7db90e, user_id=ba19132a5049407ea836cbcaf73d3258, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:26.493636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:26.512759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 61/122] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:26 2022] PUT /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/ba19132a5049407ea836cbcaf73d3258/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:26.513756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:26.538941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 62/123] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:26.540577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee983-a76c-459d-9b5f-c7f0955c7fe5 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.540877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee983-a76c-459d-9b5f-c7f0955c7fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.541167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebee983-a76c-459d-9b5f-c7f0955c7fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.574277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0ebee983-a76c-459d-9b5f-c7f0955c7fe5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:26.575591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0ebee983-a76c-459d-9b5f-c7f0955c7fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:26.691193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf22b5c-fc81-43bd-80b0-2291f57e3969 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:26.723391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 63/124] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:26.724264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebee983-a76c-459d-9b5f-c7f0955c7fe5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:26.731260 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:26.741137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:26.742084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.742608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.745307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.754078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:26.827312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:26.830862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:26.917416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebee983-a76c-459d-9b5f-c7f0955c7fe5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:26.959478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:26.960309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:26.960598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:26.960877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:26.982433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:26.990722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:26.991644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:26.992408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:27.000197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 62/125] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:27.001082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.002014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 64/126] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:27.011294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.044399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:27.131234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:27.162618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c6976-f77c-45c5-b703-b16746ea11ff None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:27.179569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfd6b2-8438-4a04-afdc-9558b515680d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:27.224671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:27.225486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:27.225775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:27.226058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:27.238238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:27.238935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:27.239217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:27.239498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:27.240251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:27.240561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:27.242012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:27.250133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:27.263318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:27.264191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:27.265638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 63/127] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:27.266297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.270152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 65/128] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:27.270876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.444073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:27.452740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4ad7a8-b366-4b1c-9fc8-ebb6f4e71c04 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:27.474764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e2ea3-4933-415f-9c94-9388f0d9ba39 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:27.499550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:27.500538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:27.501016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:27.501501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:27.502514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:27.503051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:27.504740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:27.521757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:27.522662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:27.522995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:27.523224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 66/129] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:27.523324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:27.524286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.527610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:27.527999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:27.529154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:27.530954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 64/130] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:27.531674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.687539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3f7b2-e09b-4712-823a-fc0ac0885ecd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:27.750474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:27.753981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:27.755741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:27.756212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:27.759579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7157d35-29a4-46f6-a2a3-00c73d143c4d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:27.760729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:27.762366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:27.765519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 67/131] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:27.767446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.804151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:27.805350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:27.806349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:27.806860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:27.808350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:27.809974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:27.811903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 65/132] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:27.812898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:27.841071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:27.940384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b56df-d8f3-44f8-89e3-328708bb15a2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:27.955054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:27.980351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:27.981646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:27.982116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:27.982570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:27.983992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:27.985771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:27.987750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 66/133] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:27.988985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:28.011627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43537d26-13ad-457d-897c-43434ff10076 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:28.075807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:28.076478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.076768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.077049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.078014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] RBAC: Adding query filter params (role.id=c39f354dff1b4eeb81a60bd4bc806c70, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=2e971d629bbb470ca003888d2b41d2d0) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:28.078312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:28.079900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:28.088961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:28.097108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 68/134] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/role_assignments?user.id=2e971d629bbb470ca003888d2b41d2d0&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=c39f354dff1b4eeb81a60bd4bc806c70 => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:28.097927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:28.104282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48448fb-10dd-4ae4-9c2c-991d597d794c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:28.158194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:28.159466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.159936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.160392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] PATH_INFO: `/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.161770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] RBAC: Authorizing `identity:get_project(project_id=fbdbf3efee5a4a518dffdc77eb76e4df)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:28.170871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:28.173933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 67/135] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:27 2022] GET /identity/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:28.179614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:28.323691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481b537-8c63-4fb2-9c6e-c9476497c0a5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:28.370626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf08b6b-cc64-4dbb-8b53-73a6eb7464dc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:28.396689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fe476-3a07-45d8-ad9a-fc3ddbfbb000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:28.397609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe476-3a07-45d8-ad9a-fc3ddbfbb000 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.397899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe476-3a07-45d8-ad9a-fc3ddbfbb000 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.398284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fe476-3a07-45d8-ad9a-fc3ddbfbb000 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/ba19132a5049407ea836cbcaf73d3258/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.404744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe476-3a07-45d8-ad9a-fc3ddbfbb000 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc54ff0c5398464b9c085152fd7db90e, user_id=ba19132a5049407ea836cbcaf73d3258, role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:28.406260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fe476-3a07-45d8-ad9a-fc3ddbfbb000 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:28.412256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:28.419573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60500a-b139-4936-9e72-e25462623705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:28.420491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60500a-b139-4936-9e72-e25462623705 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.420804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60500a-b139-4936-9e72-e25462623705 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.421083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60500a-b139-4936-9e72-e25462623705 None admin] PATH_INFO: `/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df/users/ba19132a5049407ea836cbcaf73d3258/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.423281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60500a-b139-4936-9e72-e25462623705 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbdbf3efee5a4a518dffdc77eb76e4df, user_id=ba19132a5049407ea836cbcaf73d3258, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:28.424673 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60500a-b139-4936-9e72-e25462623705 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:28.441614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 69/136] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:28 2022] PUT /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/ba19132a5049407ea836cbcaf73d3258/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:28.461243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:28 2022] PUT /identity/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df/users/ba19132a5049407ea836cbcaf73d3258/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:58:28.749920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34420-2558-403b-b03f-9bdf7636ea78 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.750297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34420-2558-403b-b03f-9bdf7636ea78 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.750499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f34420-2558-403b-b03f-9bdf7636ea78 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.751990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 70/138] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:28.772838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df071-cb14-4f15-8672-7c71e787ac3f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.773367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df071-cb14-4f15-8672-7c71e787ac3f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.773439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21df071-cb14-4f15-8672-7c71e787ac3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.803309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f21df071-cb14-4f15-8672-7c71e787ac3f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:28.804537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f21df071-cb14-4f15-8672-7c71e787ac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:28.822700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:28.888596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429927c7-a713-4d0b-a8fb-1e6f72e01ea7 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.888892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429927c7-a713-4d0b-a8fb-1e6f72e01ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.889076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429927c7-a713-4d0b-a8fb-1e6f72e01ea7 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.890659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 71/139] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:28.896342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7ed5d-aaed-49a0-8f7e-e0bfcdf1a6dc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:28.896625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7ed5d-aaed-49a0-8f7e-e0bfcdf1a6dc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:28.896915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7ed5d-aaed-49a0-8f7e-e0bfcdf1a6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:28.912580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 69/140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:28.920048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c6c7ed5d-aaed-49a0-8f7e-e0bfcdf1a6dc None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:28.921253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c6c7ed5d-aaed-49a0-8f7e-e0bfcdf1a6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:28.950933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21df071-cb14-4f15-8672-7c71e787ac3f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:29.022322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 72/141] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:29.060698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7ed5d-aaed-49a0-8f7e-e0bfcdf1a6dc None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:29.137319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21df071-cb14-4f15-8672-7c71e787ac3f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:29.220433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:29.221246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:29.221544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:29.221825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:29.223752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:29.225222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:29.226911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 70/142] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:29.233526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:29.263392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7ed5d-aaed-49a0-8f7e-e0bfcdf1a6dc None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:29.271187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:29.324916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:29.341787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de429ae-d28a-40a7-8d55-e102b5e6948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:29.342996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de429ae-d28a-40a7-8d55-e102b5e6948d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:29.343478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de429ae-d28a-40a7-8d55-e102b5e6948d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:29.346872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de429ae-d28a-40a7-8d55-e102b5e6948d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:29.366361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de429ae-d28a-40a7-8d55-e102b5e6948d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6de429ae-d28a-40a7-8d55-e102b5e6948d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:29.375566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:29.376422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:29.377266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:29.379398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 73/143] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:29.381082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae0def-e52c-4506-aeec-c15dc3708d2d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:29.381543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae0def-e52c-4506-aeec-c15dc3708d2d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:29.381980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae0def-e52c-4506-aeec-c15dc3708d2d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:29.384214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 74/144] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:29.387865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae0def-e52c-4506-aeec-c15dc3708d2d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:29.428290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afa128-f350-487e-865a-698b37a71ed7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:29.497783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333eaac-8d32-47e0-b055-b1f28c7e1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:29.498438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333eaac-8d32-47e0-b055-b1f28c7e1b19 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:29.498733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333eaac-8d32-47e0-b055-b1f28c7e1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:29.499040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333eaac-8d32-47e0-b055-b1f28c7e1b19 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:29.499783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333eaac-8d32-47e0-b055-b1f28c7e1b19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:29.501600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1333eaac-8d32-47e0-b055-b1f28c7e1b19 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:29.550283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 71/145] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:58:29 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:29.551632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0414df9-4fae-4371-9c3b-e175d879811f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:29.551937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0414df9-4fae-4371-9c3b-e175d879811f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:29.552226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0414df9-4fae-4371-9c3b-e175d879811f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:29.590692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae0def-e52c-4506-aeec-c15dc3708d2d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:29.624050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e0414df9-4fae-4371-9c3b-e175d879811f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:29.625304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e0414df9-4fae-4371-9c3b-e175d879811f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:29.660857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:29.661553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:29.661896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:29.662183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:29.663089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:29.663403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:29.665089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:29.681613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 75/146] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:29.688121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:29.783981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:29.830933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 72/147] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:29.874674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0414df9-4fae-4371-9c3b-e175d879811f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:29.877928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:29.906535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0be7d-4c9c-4ced-bf16-d7bf8736b0ac None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:29.970309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:29.971576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:29.972061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:29.972533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] PATH_INFO: `/v3/users/561da2b4baef46ee96092703640e527b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:29.974231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] RBAC: Authorizing `identity:get_user(user_id=561da2b4baef46ee96092703640e527b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:29.977050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:29.979774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 76/148] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:29 2022] GET /identity/v3/users/561da2b4baef46ee96092703640e527b => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:29.986511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:30.073884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0414df9-4fae-4371-9c3b-e175d879811f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:30.132530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:30.134321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:30.134818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:30.135321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:30.147795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:30.156361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:30.157226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:30.157976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:30.160398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 73/149] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:30.167692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:30.186770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cd1af-a698-4808-a5eb-a280fa00112e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:30.213749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:30.248257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:30.249280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:30.249774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:30.250247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:30.279577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:30.349956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7492f68-5706-4b95-b217-57fa9ce52a15 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:30.374683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:30.376191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:30.412324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:30.413004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:30.413291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:30.413569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:30.414336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:30.414651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:30.416600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:30.435408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 74/150] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:30.440928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:30.563973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 77/151] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:30.570194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:30.601851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:30.641535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c958a98-fd5c-404d-93d4-fce44959d534 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:30.671213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:30.682696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:30.684829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:30.685122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:30.685405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:30.686679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:30.688410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:30.690439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 75/152] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:30 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:30.695945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:30.818550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d74250-fc9c-45a3-bfa8-0449484a8601 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:30.838250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f043a0-5e2e-47c2-a914-c4a75a15295b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:30.859575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:30.860215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:30.860443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:30.860724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:30.936924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:30.938404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:30.959321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:30.973406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:30.974394 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:30.974680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:30.974984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:30.976212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:30.977726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:30.979657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 78/153] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:30 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:30.985588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:31.049581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 76/154] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:31.055161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:31.125247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:31.154266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7b689-3085-446d-887d-a8a3289bf1ee None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:31.205437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:31.206110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:31.206397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:31.206672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:31.207548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=561da2b4baef46ee96092703640e527b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:31.207856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:31.209122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a4541-eb50-401c-a079-1397d8a2aea5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:31.209314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:31.212210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:31.220969 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 79/155] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:30 2022] GET /identity/v3/role_assignments?user.id=561da2b4baef46ee96092703640e527b&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:31.258064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03246312-738c-4dbe-a736-a78f8dd455a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:31.259618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246312-738c-4dbe-a736-a78f8dd455a0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:31.259907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246312-738c-4dbe-a736-a78f8dd455a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:31.260186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03246312-738c-4dbe-a736-a78f8dd455a0 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:31.263735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03246312-738c-4dbe-a736-a78f8dd455a0 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:31.265272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03246312-738c-4dbe-a736-a78f8dd455a0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:31.267540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 77/156] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:31 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:31.272975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:31.408856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c1f76-31f7-488d-a9c9-4c1b4fffa9dd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:31.452462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f510b75-2b8d-4706-ae82-c54f34508f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:31.453151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510b75-2b8d-4706-ae82-c54f34508f5b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:31.453436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510b75-2b8d-4706-ae82-c54f34508f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:31.453718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f510b75-2b8d-4706-ae82-c54f34508f5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:31.454580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f510b75-2b8d-4706-ae82-c54f34508f5b None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=ba19132a5049407ea836cbcaf73d3258) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:31.454916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f510b75-2b8d-4706-ae82-c54f34508f5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:31.456426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f510b75-2b8d-4706-ae82-c54f34508f5b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:31.469185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 80/157] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:31 2022] GET /identity/v3/role_assignments?user.id=ba19132a5049407ea836cbcaf73d3258&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=2f1a975d114c4307b75105be01055d98 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:31.723174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f73eaf-a032-42db-b6b6-a61c45c4b59c None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:31.723464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f73eaf-a032-42db-b6b6-a61c45c4b59c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:31.723669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f73eaf-a032-42db-b6b6-a61c45c4b59c None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:31.725211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 78/158] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:31.731339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b757-da0f-4e71-92a6-d9abbee33027 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:31.731697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b757-da0f-4e71-92a6-d9abbee33027 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:31.731908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80b757-da0f-4e71-92a6-d9abbee33027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:31.750015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6d80b757-da0f-4e71-92a6-d9abbee33027 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:31.755330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6d80b757-da0f-4e71-92a6-d9abbee33027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:31.763901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:31.837076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 81/159] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:31.882514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a10218-f7ac-44b6-b4ff-504ba3cb5209 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:31.883063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a10218-f7ac-44b6-b4ff-504ba3cb5209 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:31.883139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a10218-f7ac-44b6-b4ff-504ba3cb5209 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:31.884789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 79/160] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:31.885809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80b757-da0f-4e71-92a6-d9abbee33027 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:31.896256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceacf13-eb7a-4c14-a07b-45d569957413 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:31.896580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceacf13-eb7a-4c14-a07b-45d569957413 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:31.896829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceacf13-eb7a-4c14-a07b-45d569957413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:31.926894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5ceacf13-eb7a-4c14-a07b-45d569957413 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:31.928106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5ceacf13-eb7a-4c14-a07b-45d569957413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:32.061946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 80/161] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:32.063083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c922aa-058c-4abb-ab14-14bd6c70beff None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.063482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c922aa-058c-4abb-ab14-14bd6c70beff None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.063651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c922aa-058c-4abb-ab14-14bd6c70beff None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.065060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 81/162] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:32.070250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21453f-2cd3-4cb3-9f4a-ac6dee938ab3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.070534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21453f-2cd3-4cb3-9f4a-ac6dee938ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.071130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21453f-2cd3-4cb3-9f4a-ac6dee938ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.091742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2c21453f-2cd3-4cb3-9f4a-ac6dee938ab3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:32.092053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80b757-da0f-4e71-92a6-d9abbee33027 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:32.092946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2c21453f-2cd3-4cb3-9f4a-ac6dee938ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:32.144751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:32.145540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.145827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.146099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.162322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:32.174873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:32.175738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:32.176571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 82/163] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:32.177216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:32.180734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:32.183835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 82/164] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:32.184782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21453f-2cd3-4cb3-9f4a-ac6dee938ab3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:32.242368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:32.313164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b83a4-aad5-4287-9c16-b4bf66147f88 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:32.350740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:32.351582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.351870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.352206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.363910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:32.372613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:32.373463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:32.374243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 83/165] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:32.375079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:32.446293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:32.458921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21453f-2cd3-4cb3-9f4a-ac6dee938ab3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:32.487883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32196b-5929-4717-928f-5269869555d7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:32.536090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:32.536771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.537056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.537332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.538093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:32.538398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:32.540542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:32.552088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:32.552907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.553189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.553468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.562197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 83/166] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:32.562885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:32.577201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:32.585751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:32.586654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:32.587479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 84/167] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:32.588196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:32.697334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601847e-ccb5-49fa-9e39-88fec3198664 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:32.727919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:32.733071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:32.734091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:32.735406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.735836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.736257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.737747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:32.739401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:32.741199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:32.742103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:32.766869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d8e1f-9a5e-4c50-944c-d38eed8507e3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:32.840776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:32.840776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.841038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.841311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.842086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:32.842398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:32.843844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:32.865009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 84/169] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:32.865954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:32.879993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960454-9e18-48ac-b207-7ff5de79847a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:32.917939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:32.919327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:32.919762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:32.920369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:32.921266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:32.921745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:32.923304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:32.936372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 86/170] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:32.937616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:33.007325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:33.054549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f553d7-e1b2-419f-a48b-53afe7c12eb8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:33.100127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:33.101240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.104020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.104456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] PATH_INFO: `/v3/users/2e971d629bbb470ca003888d2b41d2d0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.106144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] RBAC: Authorizing `identity:get_user(user_id=2e971d629bbb470ca003888d2b41d2d0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:33.108841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:33.110852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 87/171] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/users/2e971d629bbb470ca003888d2b41d2d0 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:33.112438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:33.158862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51dc550-cb02-4420-8239-b5868d078d2f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:33.233345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:33.235700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.237060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.237497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.278895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:33.330994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c16d16-ffa7-4d0e-a705-b4db69a2b0e5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:33.362581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:33.377060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:33.378395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.378902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.379392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] PATH_INFO: `/v3/users/ba19132a5049407ea836cbcaf73d3258` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.380914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] RBAC: Authorizing `identity:get_user(user_id=ba19132a5049407ea836cbcaf73d3258)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:33.382576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:33.384993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 88/172] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:33 2022] GET /identity/v3/users/ba19132a5049407ea836cbcaf73d3258 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:33.385958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:33.387911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:33.389491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:33.493674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08011b82-2746-46bb-9732-71bc7278d613 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:33.508218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 85/173] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:33.509831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:33.533822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e31767-cbbe-4c86-919f-930df8a739bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:33.535174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31767-cbbe-4c86-919f-930df8a739bb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.535725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31767-cbbe-4c86-919f-930df8a739bb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.536197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e31767-cbbe-4c86-919f-930df8a739bb None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.537747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31767-cbbe-4c86-919f-930df8a739bb None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:33.539573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e31767-cbbe-4c86-919f-930df8a739bb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:33.541730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 89/174] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:33 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:33.543128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4d1e-2130-47bc-bd83-de81cf995bfe None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.543618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4d1e-2130-47bc-bd83-de81cf995bfe None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.544105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a4d1e-2130-47bc-bd83-de81cf995bfe None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.545699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 90/175] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:33.546579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a4d1e-2130-47bc-bd83-de81cf995bfe None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:33.562321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:33.610246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:33.624177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a4a43-8193-4169-8a3c-109c60c9b427 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:33.665382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:33.666083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.666371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.666691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.672476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a4d1e-2130-47bc-bd83-de81cf995bfe None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:33.709533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa30ea-4068-43e1-b3dd-f11974f5ed59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:33.710883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa30ea-4068-43e1-b3dd-f11974f5ed59 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.711368 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa30ea-4068-43e1-b3dd-f11974f5ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.711864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa30ea-4068-43e1-b3dd-f11974f5ed59 None admin] PATH_INFO: `/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.713344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa30ea-4068-43e1-b3dd-f11974f5ed59 None admin] RBAC: Authorizing `identity:get_project(project_id=fbdbf3efee5a4a518dffdc77eb76e4df)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:33.715138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aa30ea-4068-43e1-b3dd-f11974f5ed59 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:33.717167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 91/176] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:33 2022] GET /identity/v3/projects/fbdbf3efee5a4a518dffdc77eb76e4df => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:33.718641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3a55-c7ba-4637-87ed-7dd5a2b732f4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.719160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3a55-c7ba-4637-87ed-7dd5a2b732f4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.719651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab3a55-c7ba-4637-87ed-7dd5a2b732f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.737993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d2ab3a55-c7ba-4637-87ed-7dd5a2b732f4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:33.739744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d2ab3a55-c7ba-4637-87ed-7dd5a2b732f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:33.744496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:33.745295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:33.797107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:33.817055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 92/177] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:33.818203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab3a55-c7ba-4637-87ed-7dd5a2b732f4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:33.880123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:33.889720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 86/178] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:33.895623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:33.930160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab3a55-c7ba-4637-87ed-7dd5a2b732f4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:33.973587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:33.974492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:33.974775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:33.975081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/2e971d629bbb470ca003888d2b41d2d0/roles/c39f354dff1b4eeb81a60bd4bc806c70` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:33.977968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] RBAC: Authorizing `identity:create_grant(project_id=cc54ff0c5398464b9c085152fd7db90e, user_id=2e971d629bbb470ca003888d2b41d2d0, role_id=c39f354dff1b4eeb81a60bd4bc806c70)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:33.979600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:33.993763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 93/179] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:33 2022] PUT /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e/users/2e971d629bbb470ca003888d2b41d2d0/roles/c39f354dff1b4eeb81a60bd4bc806c70 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:33.994387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.021915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c45fd4-0668-4a0f-b79e-d519c5f69aa3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.066365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.067322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.067813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.068191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.069197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=fbdbf3efee5a4a518dffdc77eb76e4df, user.id=ba19132a5049407ea836cbcaf73d3258) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:34.069616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:34.071744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:34.079213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 87/180] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:33 2022] GET /identity/v3/role_assignments?user.id=ba19132a5049407ea836cbcaf73d3258&scope.project.id=fbdbf3efee5a4a518dffdc77eb76e4df&role.id=2f1a975d114c4307b75105be01055d98 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:34.080298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.093812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.105670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a6e8e-2117-42d3-b222-37bb0d51a11f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.122432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.145163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62e011-ae2a-4888-b88f-8732956b3070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.146051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62e011-ae2a-4888-b88f-8732956b3070 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.146646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62e011-ae2a-4888-b88f-8732956b3070 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.147206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62e011-ae2a-4888-b88f-8732956b3070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.159506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62e011-ae2a-4888-b88f-8732956b3070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8c62e011-ae2a-4888-b88f-8732956b3070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:34.168158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:34.169111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 94/181] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:34.171169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472680ce-5958-450a-a314-8ee19fd1df5b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.175784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472680ce-5958-450a-a314-8ee19fd1df5b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.176109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472680ce-5958-450a-a314-8ee19fd1df5b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.177736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 95/182] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:34.178358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472680ce-5958-450a-a314-8ee19fd1df5b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.211702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854831b7-61d7-458e-a15f-b4550e90d912 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.255727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68d5ba-ac09-41cb-aa74-367991dad04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.256771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d5ba-ac09-41cb-aa74-367991dad04f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.257063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d5ba-ac09-41cb-aa74-367991dad04f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.257454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68d5ba-ac09-41cb-aa74-367991dad04f None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.258914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d5ba-ac09-41cb-aa74-367991dad04f None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:34.260561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68d5ba-ac09-41cb-aa74-367991dad04f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:34.262628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 88/183] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:34.263944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f655-bcd4-4e1d-90f8-43ef18efce35 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.264236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f655-bcd4-4e1d-90f8-43ef18efce35 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.264519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f655-bcd4-4e1d-90f8-43ef18efce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.284777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0c74f655-bcd4-4e1d-90f8-43ef18efce35 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:34.286133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0c74f655-bcd4-4e1d-90f8-43ef18efce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:34.316187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472680ce-5958-450a-a314-8ee19fd1df5b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.356355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.357042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.357327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.357606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.358381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:34.358690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:34.360145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:34.369820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 96/184] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:34.370693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.371394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 89/185] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:34.376791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f655-bcd4-4e1d-90f8-43ef18efce35 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.385930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.417552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.489490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fdfb2-cc76-4d35-b6fd-4bfcbdb1efe1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.495043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f655-bcd4-4e1d-90f8-43ef18efce35 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.531542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35da080-12b0-4605-81c0-3bbe9e6e536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.532767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35da080-12b0-4605-81c0-3bbe9e6e536c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.533293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35da080-12b0-4605-81c0-3bbe9e6e536c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.533785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35da080-12b0-4605-81c0-3bbe9e6e536c None admin] PATH_INFO: `/v3/users/19d145a7110b407e8f0b70867d09ed10` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.533888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.534511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.534815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.535097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.535938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] RBAC: Adding query filter params (role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=ba19132a5049407ea836cbcaf73d3258) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:34.536250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:34.537706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:34.546120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 97/186] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/role_assignments?user.id=ba19132a5049407ea836cbcaf73d3258&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:34.546750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.564066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35da080-12b0-4605-81c0-3bbe9e6e536c None admin] RBAC: Authorizing `identity:get_user(user_id=19d145a7110b407e8f0b70867d09ed10)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:34.565242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35da080-12b0-4605-81c0-3bbe9e6e536c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:34.567424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 90/187] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/users/19d145a7110b407e8f0b70867d09ed10 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:34.568880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5566db-2e11-43a3-a005-9ef174bf7378 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.569172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5566db-2e11-43a3-a005-9ef174bf7378 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.569483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5566db-2e11-43a3-a005-9ef174bf7378 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.572058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 91/188] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:34.577023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5566db-2e11-43a3-a005-9ef174bf7378 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.665646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.670942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.674439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a04c62-fdfe-408b-8b9d-8fd450afc865 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.713101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbd294-8d5e-45cd-991b-e231b60f7396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.714127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbd294-8d5e-45cd-991b-e231b60f7396 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.714515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbd294-8d5e-45cd-991b-e231b60f7396 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.714926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbd294-8d5e-45cd-991b-e231b60f7396 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.716725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5566db-2e11-43a3-a005-9ef174bf7378 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.727729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbd294-8d5e-45cd-991b-e231b60f7396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4bdbd294-8d5e-45cd-991b-e231b60f7396 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:34.736404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:34.737504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:34.738276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:34.744026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 98/189] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:34.744026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c302d2c-fdbd-4291-82f4-95359cfa2c83 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.744026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c302d2c-fdbd-4291-82f4-95359cfa2c83 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.744026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c302d2c-fdbd-4291-82f4-95359cfa2c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.762834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8c302d2c-fdbd-4291-82f4-95359cfa2c83 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:34.764199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8c302d2c-fdbd-4291-82f4-95359cfa2c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:34.781052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:34.781719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:34.782006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:34.782288 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:34.858549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 99/190] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:34.860057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c302d2c-fdbd-4291-82f4-95359cfa2c83 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:34.881773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:34.883658 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:34.951374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.959753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:34.970065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c302d2c-fdbd-4291-82f4-95359cfa2c83 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:34.996210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 92/191] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:34.997425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:35.008638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.009524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.009805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.010077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.010825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:35.011161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.012528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.025338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 100/192] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:35.025338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:35.111088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e5ec8-4463-4374-b013-37f9fbf7a3f1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:35.128877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9115f02-311b-40ec-89bd-681fb3105d03 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:35.146680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.147604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.147904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.148187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.149897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.151368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.157538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 93/193] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:35.157538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:35.168821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.169687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.169975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.170250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.171470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.172934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.179336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 101/194] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:35 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:35.179336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:35.193869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:35.200525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:35.271295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f9fa7-ad57-4c38-a417-3db9564c8336 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:35.283275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd920aa-e292-4cc5-9937-720deca446b7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:35.306575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.307478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.307767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.308040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] PATH_INFO: `/v3/users/19d145a7110b407e8f0b70867d09ed10` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.309228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=19d145a7110b407e8f0b70867d09ed10)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.310663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.312513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 94/195] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:35 2022] GET /identity/v3/users/19d145a7110b407e8f0b70867d09ed10 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:35.313077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:35.324418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.325088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.325368 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.325965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.326341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.327910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.348389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 102/196] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:58:35 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:35.349570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:35.445374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:35.472982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:35.477532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816f1c-ba0c-432e-9584-ea3e965feaf2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:35.485779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855759e1-d7f8-4e0c-a150-67a58df1e2ed None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:35.517131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.518178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.518178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.518370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.519240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=19d145a7110b407e8f0b70867d09ed10) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:35.519557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.521049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.529652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 95/197] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:35 2022] GET /identity/v3/role_assignments?user.id=19d145a7110b407e8f0b70867d09ed10&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:35.541961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.542644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.542966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.543247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.626259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.627882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.717722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:35.747417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 103/198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:35.752727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:35.869016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcabf63-9f56-4342-a16b-4a9961113b17 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:35.906343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fa6dfe-0ddb-4839-9f84-ad7091d3fd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:35.907249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6dfe-0ddb-4839-9f84-ad7091d3fd2b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:35.907538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6dfe-0ddb-4839-9f84-ad7091d3fd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:35.907818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fa6dfe-0ddb-4839-9f84-ad7091d3fd2b None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:35.909029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa6dfe-0ddb-4839-9f84-ad7091d3fd2b None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:35.910500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fa6dfe-0ddb-4839-9f84-ad7091d3fd2b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:35.912613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 96/199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:35 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:35.918101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:36.048250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17a00d-200d-473a-b474-eefe0918dbae None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:36.129484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fc2412-3249-471e-ab76-66f8bd432a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:36.130081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc2412-3249-471e-ab76-66f8bd432a31 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:36.130367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc2412-3249-471e-ab76-66f8bd432a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:36.130643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fc2412-3249-471e-ab76-66f8bd432a31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:36.131518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc2412-3249-471e-ab76-66f8bd432a31 None admin] RBAC: Adding query filter params (role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=19d145a7110b407e8f0b70867d09ed10) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:36.131833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc2412-3249-471e-ab76-66f8bd432a31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:36.133343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fc2412-3249-471e-ab76-66f8bd432a31 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:36.139776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 104/200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:35 2022] GET /identity/v3/role_assignments?user.id=19d145a7110b407e8f0b70867d09ed10&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:36.668962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4882-8a1d-4d0a-acee-eff6d5e8b62e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:36.669496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4882-8a1d-4d0a-acee-eff6d5e8b62e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:36.669496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc4882-8a1d-4d0a-acee-eff6d5e8b62e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:36.671101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 97/201] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:36.676819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6b1b-2532-47c3-b814-74eb5a7db7a3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:36.677115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6b1b-2532-47c3-b814-74eb5a7db7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:36.677393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc6b1b-2532-47c3-b814-74eb5a7db7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:36.708265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dbbc6b1b-2532-47c3-b814-74eb5a7db7a3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:36.709470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dbbc6b1b-2532-47c3-b814-74eb5a7db7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:36.757762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:36.791970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 105/202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:36.836158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4882-8a1d-4d0a-acee-eff6d5e8b62e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:36.876500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:36.976506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc4882-8a1d-4d0a-acee-eff6d5e8b62e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:37.017433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:37.018232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:37.018516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:37.018789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:37.030268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:37.038162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:37.039051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:37.039860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 98/203] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:37.045276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6b1b-2532-47c3-b814-74eb5a7db7a3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:37.158042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc6b1b-2532-47c3-b814-74eb5a7db7a3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:37.194055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:37.194722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:37.195032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:37.195301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:37.196839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:37.197141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:37.198521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:37.207648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 106/204] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:37.213629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:37.330510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:37.339562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f69e2-2d92-4ee5-97c2-2cedbce1f8d6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:37.389857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:37.390735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:37.391042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:37.391319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] PATH_INFO: `/v3/users/2e971d629bbb470ca003888d2b41d2d0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:37.392514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] RBAC: Authorizing `identity:get_user(user_id=2e971d629bbb470ca003888d2b41d2d0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:37.393953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:37.395595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 99/205] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:37 2022] GET /identity/v3/users/2e971d629bbb470ca003888d2b41d2d0 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:37.401135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:37.433803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:37.527279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00def7c0-dd82-461f-84d3-8e039e05c602 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:37.566454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:37.567121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:37.567400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:37.567668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:37.636896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:37.638374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:37.668907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:37.738962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 107/206] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:37.745151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:37.866406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c079e9-0c86-4545-af05-57d4bc1926f8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:37.912066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c64cc3-62e6-488e-83ef-b119b6871843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:37.912909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64cc3-62e6-488e-83ef-b119b6871843 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:37.913195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64cc3-62e6-488e-83ef-b119b6871843 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:37.913467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c64cc3-62e6-488e-83ef-b119b6871843 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:37.915235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64cc3-62e6-488e-83ef-b119b6871843 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:37.916675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c64cc3-62e6-488e-83ef-b119b6871843 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:37.918392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 100/207] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:37 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:37.924311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:38.026416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2db81-eb2f-4bdb-98ff-e3d187c3834b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:38.056473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:38.061832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aaa88-8e71-4903-b24c-5fc22773d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:38.062339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aaa88-8e71-4903-b24c-5fc22773d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.063043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aaa88-8e71-4903-b24c-5fc22773d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.063319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aaa88-8e71-4903-b24c-5fc22773d1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.064211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aaa88-8e71-4903-b24c-5fc22773d1e7 None admin] RBAC: Adding query filter params (role.id=c39f354dff1b4eeb81a60bd4bc806c70, scope.project.id=cc54ff0c5398464b9c085152fd7db90e, user.id=2e971d629bbb470ca003888d2b41d2d0) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:38.064526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aaa88-8e71-4903-b24c-5fc22773d1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:38.065959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aaa88-8e71-4903-b24c-5fc22773d1e7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:38.075094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 108/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:37 2022] GET /identity/v3/role_assignments?user.id=2e971d629bbb470ca003888d2b41d2d0&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=c39f354dff1b4eeb81a60bd4bc806c70 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:38.388489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4bed-45ac-400f-aa63-295ce023e481 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.388862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4bed-45ac-400f-aa63-295ce023e481 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.389038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d4bed-45ac-400f-aa63-295ce023e481 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.390674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 101/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:38.396284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464ced-9838-4965-a34c-1998c29d1260 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.396748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464ced-9838-4965-a34c-1998c29d1260 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.396825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464ced-9838-4965-a34c-1998c29d1260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.416796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e6464ced-9838-4965-a34c-1998c29d1260 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:38.417978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e6464ced-9838-4965-a34c-1998c29d1260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:38.475075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092f270-78fe-4513-8a0d-256b449f1c8d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.475398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092f270-78fe-4513-8a0d-256b449f1c8d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.475646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092f270-78fe-4513-8a0d-256b449f1c8d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.477332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 102/210] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:38.480556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13dcc-2c54-4266-b23e-17104ef29444 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.481097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13dcc-2c54-4266-b23e-17104ef29444 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.481752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd13dcc-2c54-4266-b23e-17104ef29444 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.483236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 103/211] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:38.484198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3875eb-e6f3-46c7-942f-c1ae2daa1b93 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.484492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3875eb-e6f3-46c7-942f-c1ae2daa1b93 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.484769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3875eb-e6f3-46c7-942f-c1ae2daa1b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.497536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 109/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:38.499133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b80aa-b0b5-46be-be0f-3427c9fe764d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.499611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b80aa-b0b5-46be-be0f-3427c9fe764d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.499889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b80aa-b0b5-46be-be0f-3427c9fe764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.515330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1a3875eb-e6f3-46c7-942f-c1ae2daa1b93 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:38.516682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1a3875eb-e6f3-46c7-942f-c1ae2daa1b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:38.522388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e98b80aa-b0b5-46be-be0f-3427c9fe764d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:38.524617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e98b80aa-b0b5-46be-be0f-3427c9fe764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:38.544868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:38.593048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 104/213] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:38.594016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3875eb-e6f3-46c7-942f-c1ae2daa1b93 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:38.601413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 110/214] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:38.614932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b80aa-b0b5-46be-be0f-3427c9fe764d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:38.672956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:38.713661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3875eb-e6f3-46c7-942f-c1ae2daa1b93 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:38.723926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b80aa-b0b5-46be-be0f-3427c9fe764d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:38.748536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:38.749337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.749622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.749899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.751093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:38.752542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:38.754173 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 105/215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:38.754967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:38.767048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:38.767917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.768308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.768588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.780991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:38.785966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:38.789132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:38.790093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:38.790917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 111/216] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:38.796271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:38.868529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b8ae-bd0e-428f-849e-78814f96cfae None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:38.904301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5124f-328b-4120-96ea-17ac84cb7886 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:38.907187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:38.907997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.908281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.908557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.919331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:38.921250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:38.927685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:38.928620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:38.929423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 106/217] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:38.934803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:38.943315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:38.943991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:38.944317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:38.944597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:38.945307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:38.947705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:38.968706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 112/218] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:58:38 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:38.969539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.041434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:39.060173 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12897639-892a-47f6-8ccd-59616019a366 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.081947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0b4a4-efb7-4034-9465-e7a356c10ff4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.100716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e03be-7014-4d8c-836f-a59c8717833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.102168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e03be-7014-4d8c-836f-a59c8717833f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.102604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e03be-7014-4d8c-836f-a59c8717833f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.103065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e03be-7014-4d8c-836f-a59c8717833f None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.104014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e03be-7014-4d8c-836f-a59c8717833f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:39.105052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e03be-7014-4d8c-836f-a59c8717833f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.106954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e03be-7014-4d8c-836f-a59c8717833f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.119793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb87a3e-9ac4-4c64-819b-97526a467846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.120181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 107/219] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:39.120470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87a3e-9ac4-4c64-819b-97526a467846 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.120758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87a3e-9ac4-4c64-819b-97526a467846 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.121026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb87a3e-9ac4-4c64-819b-97526a467846 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.121787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb87a3e-9ac4-4c64-819b-97526a467846 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:39.122092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb87a3e-9ac4-4c64-819b-97526a467846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.122408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35bcd-1261-4964-8c39-7d7234359b84 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.122957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35bcd-1261-4964-8c39-7d7234359b84 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.123398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f35bcd-1261-4964-8c39-7d7234359b84 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.123679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb87a3e-9ac4-4c64-819b-97526a467846 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.125417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 108/220] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:39.126364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f35bcd-1261-4964-8c39-7d7234359b84 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.137158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 113/221] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:39.140344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788901-afbc-438f-912b-6439872af040 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.140911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788901-afbc-438f-912b-6439872af040 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.141481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788901-afbc-438f-912b-6439872af040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.159600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-17788901-afbc-438f-912b-6439872af040 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:39.161029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-17788901-afbc-438f-912b-6439872af040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:39.194508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:39.247239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 114/222] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:39.248144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788901-afbc-438f-912b-6439872af040 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.249144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f35bcd-1261-4964-8c39-7d7234359b84 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.303494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.304800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.305633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.306549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] PATH_INFO: `/v3/users/19d145a7110b407e8f0b70867d09ed10` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.308357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] RBAC: Authorizing `identity:get_user(user_id=19d145a7110b407e8f0b70867d09ed10)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.310577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.312913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 109/223] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/users/19d145a7110b407e8f0b70867d09ed10 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:39.313603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.341686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:39.383720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788901-afbc-438f-912b-6439872af040 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.424360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.426571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.427376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.427846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] PATH_INFO: `/v3/users/b994aae98cda4d77870f5ef618026d87` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.433535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeff6d-217a-41a6-8240-c0662f2b53ba None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.446804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] RBAC: Authorizing `identity:get_user(user_id=b994aae98cda4d77870f5ef618026d87)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.449414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.452626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 115/224] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/users/b994aae98cda4d77870f5ef618026d87 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:39.453706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.480684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.482033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.482398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.482764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.485185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:39.497887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:39.509204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:39.510086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:39.510914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 110/225] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:39.511561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.578074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead3079-70c6-4eed-8d16-c660a41e1f50 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.602129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:39.615588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.616647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.617052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.617432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.619327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.626065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.629019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e04765-afea-463e-a9b0-2939b1a0bd6f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.638326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 116/226] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:39.638783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.666987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.668031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.668516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.668991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.745956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.747642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.748461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:39.759854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40dbcf8-e5e8-4175-9c66-ba6b3af77d5f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.798241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.799287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.799786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.800279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.801260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:39.801807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.803489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.812226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 117/227] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:39.813257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.863259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:39.890487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 111/228] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:39.896517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:39.927866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd5c17-1f94-4b52-b148-6dc26ae61062 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:39.966556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:39.967939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:39.968431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:39.968953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/19d145a7110b407e8f0b70867d09ed10/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:39.971292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb2ebcfc1134898824164d20ac1f3a2, user_id=19d145a7110b407e8f0b70867d09ed10, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:39.973065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:39.987020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 118/229] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:39 2022] PUT /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/19d145a7110b407e8f0b70867d09ed10/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:39.988216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:40.005701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:40.037077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac95068-7a87-4679-a3c0-388ca482ce58 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:40.119535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:40.122588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:40.124977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:40.126177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] PATH_INFO: `/v3/users/19d145a7110b407e8f0b70867d09ed10` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:40.129898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] RBAC: Authorizing `identity:get_user(user_id=19d145a7110b407e8f0b70867d09ed10)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:40.134497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:40.140759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 112/230] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/users/19d145a7110b407e8f0b70867d09ed10 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:40.144290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:40.160946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cb123-4f90-4f5e-a010-bac46a6ef64c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:40.211182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:40.215124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:40.215686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:40.216158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:40.217765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:40.219733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:40.222220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 119/231] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:39 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:40.232669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:40.238956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:40.303918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9400e-779d-4754-bbad-0892ea5e4798 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:40.325841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:40.349780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787729c-d624-42a9-b93d-f45c79b76a7d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:40.351035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:40.352154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:40.352351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:40.352601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:40.354477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:40.355413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:40.357551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 113/232] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:40 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:40.363138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:40.389491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1e6cb-9675-4d19-8c18-8dbbd3dd634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:40.390495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e6cb-9675-4d19-8c18-8dbbd3dd634b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:40.391038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e6cb-9675-4d19-8c18-8dbbd3dd634b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:40.391530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e6cb-9675-4d19-8c18-8dbbd3dd634b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:40.392565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1e6cb-9675-4d19-8c18-8dbbd3dd634b None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=b994aae98cda4d77870f5ef618026d87) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:40.393072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1e6cb-9675-4d19-8c18-8dbbd3dd634b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:40.394811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1e6cb-9675-4d19-8c18-8dbbd3dd634b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:40.401412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 120/233] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:40 2022] GET /identity/v3/role_assignments?user.id=b994aae98cda4d77870f5ef618026d87&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=2f1a975d114c4307b75105be01055d98 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:40.553742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9e66-c9e3-4536-9987-15753ece08ce None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:40.571648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:40.600834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cff15-3703-4ab9-9eda-e38dc19abc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:40.601748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cff15-3703-4ab9-9eda-e38dc19abc56 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:40.602070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cff15-3703-4ab9-9eda-e38dc19abc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:40.602350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cff15-3703-4ab9-9eda-e38dc19abc56 None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/19d145a7110b407e8f0b70867d09ed10/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:40.608916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cff15-3703-4ab9-9eda-e38dc19abc56 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb2ebcfc1134898824164d20ac1f3a2, user_id=19d145a7110b407e8f0b70867d09ed10, role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:40.610399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cff15-3703-4ab9-9eda-e38dc19abc56 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:40.645701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 114/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:40 2022] PUT /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/19d145a7110b407e8f0b70867d09ed10/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:58:41.478537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20024c7c-77ce-41ef-a3bb-aeb4a7710a1e None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:41.478537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20024c7c-77ce-41ef-a3bb-aeb4a7710a1e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:41.478537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20024c7c-77ce-41ef-a3bb-aeb4a7710a1e None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:41.478537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 121/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:41.484688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf70d7-f5af-490b-b966-5cfe1f0cebbb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:41.485077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf70d7-f5af-490b-b966-5cfe1f0cebbb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:41.485259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf70d7-f5af-490b-b966-5cfe1f0cebbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:41.516584 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-06cf70d7-f5af-490b-b966-5cfe1f0cebbb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:41.517792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-06cf70d7-f5af-490b-b966-5cfe1f0cebbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:41.553937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8a07-61e9-4837-8d02-5d77d7378c44 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:41.554237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8a07-61e9-4837-8d02-5d77d7378c44 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:41.554519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d8a07-61e9-4837-8d02-5d77d7378c44 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:41.556604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 122/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:41.563834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19eef-36a7-45e2-9f0d-034d5eed7eb1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:41.564127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19eef-36a7-45e2-9f0d-034d5eed7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:41.564414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a19eef-36a7-45e2-9f0d-034d5eed7eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:41.593484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-45a19eef-36a7-45e2-9f0d-034d5eed7eb1 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:41.594702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-45a19eef-36a7-45e2-9f0d-034d5eed7eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:41.621180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 115/237] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:41.651144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf70d7-f5af-490b-b966-5cfe1f0cebbb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:41.733575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 123/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:41.771431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf70d7-f5af-490b-b966-5cfe1f0cebbb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:41.772960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:41.796311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19eef-36a7-45e2-9f0d-034d5eed7eb1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:41.816548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:41.817380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:41.817664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:41.817939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:41.829971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:41.838469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:41.839400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:41.840169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 116/239] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:41.846126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:41.949921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:42.006852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a19eef-36a7-45e2-9f0d-034d5eed7eb1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:42.042944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33783f-460c-42a3-8dd8-59af6f917f78 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:42.073049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:42.073964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:42.074255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:42.074533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:42.075840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:42.077421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:42.079502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 124/240] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:42.084836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:42.091982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:42.092689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:42.092975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:42.093254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:42.094044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:42.094359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:42.095841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:42.117427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 117/241] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:42.123337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:42.183885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:42.204813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e1732-8e16-4efa-ba81-985c17f56d1c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:42.256147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:42.257245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:42.257738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:42.258278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:42.259249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:42.260924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:42.284623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a91030-da65-43ce-b7b7-38ed208aeaed None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:42.300202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:42.311992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 125/242] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:58:42 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:42.331807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:42.332750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:42.333041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:42.333323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] PATH_INFO: `/v3/users/2613ac8ef57248118412f944daf209c4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:42.349734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] RBAC: Authorizing `identity:get_user(user_id=2613ac8ef57248118412f944daf209c4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:42.351349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:42.354180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 118/243] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:42 2022] GET /identity/v3/users/2613ac8ef57248118412f944daf209c4 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:42.359409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:42.514410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52a82b-855c-4ef3-b8a4-9e1a6306b17e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:42.553151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:42.553825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:42.554113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:42.554394 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:42.639688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:42.643453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:42.644923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:42.755528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 126/244] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:42.761702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:42.865887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:42.887765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7918f250-9fba-43dc-a2f7-b548dc9162f3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:42.929089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b090-7831-45b5-8b5e-b7025bbc316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:42.930931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b090-7831-45b5-8b5e-b7025bbc316a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:42.931350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b090-7831-45b5-8b5e-b7025bbc316a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:42.931765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b090-7831-45b5-8b5e-b7025bbc316a None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:42.933147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b090-7831-45b5-8b5e-b7025bbc316a None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:42.934733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b090-7831-45b5-8b5e-b7025bbc316a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:42.941469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 119/245] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:42 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:42.942978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:43.041602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f706b3-91ab-43e1-a865-2d0e639bfc21 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.042112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f706b3-91ab-43e1-a865-2d0e639bfc21 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.042533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f706b3-91ab-43e1-a865-2d0e639bfc21 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.044092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 120/246] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:43.050355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ad162-dd96-4d58-9425-1f38ef2ccbc7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.050883 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ad162-dd96-4d58-9425-1f38ef2ccbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.051309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ad162-dd96-4d58-9425-1f38ef2ccbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.071809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4b2ad162-dd96-4d58-9425-1f38ef2ccbc7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:43.073068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4b2ad162-dd96-4d58-9425-1f38ef2ccbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:43.080999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:43.085549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b57b28-717e-43f0-ac1a-37c87e092076 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:43.124683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:43.125671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.126089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.126669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.127711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] RBAC: Adding query filter params (role.id=c39f354dff1b4eeb81a60bd4bc806c70, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=2613ac8ef57248118412f944daf209c4) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:43.128161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:43.129933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:43.141766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 127/247] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:42 2022] GET /identity/v3/role_assignments?user.id=2613ac8ef57248118412f944daf209c4&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=c39f354dff1b4eeb81a60bd4bc806c70 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:43.150984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 121/248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:43.197212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:43.200388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3705a-ecb8-473e-b938-1acdc7ad1298 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.200526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3705a-ecb8-473e-b938-1acdc7ad1298 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.200766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3705a-ecb8-473e-b938-1acdc7ad1298 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.202365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 122/249] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:43.209108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7e3c-2e4f-48b9-b5b2-a275b6c50fe3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.209108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7e3c-2e4f-48b9-b5b2-a275b6c50fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.209327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b7e3c-2e4f-48b9-b5b2-a275b6c50fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.235649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-af7b7e3c-2e4f-48b9-b5b2-a275b6c50fe3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:43.236902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-af7b7e3c-2e4f-48b9-b5b2-a275b6c50fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:43.315641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d634ec0-d9ea-4211-b414-9aac51764595 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:43.354509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:43.355708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.356186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.356672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.361303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 123/250] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:43.369241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:43.379283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:43.380174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:43.380938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:43.383474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 128/251] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:43.389704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7e3c-2e4f-48b9-b5b2-a275b6c50fe3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:43.403333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:43.411874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:43.447450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:43.570129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470587e-cab9-4287-9dfa-16fb18836369 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:43.612829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cbbce-eff1-490d-bbd8-9854b63add2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:43.613650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cbbce-eff1-490d-bbd8-9854b63add2b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.613934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cbbce-eff1-490d-bbd8-9854b63add2b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.614212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cbbce-eff1-490d-bbd8-9854b63add2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.619575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b7e3c-2e4f-48b9-b5b2-a275b6c50fe3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:43.631547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cbbce-eff1-490d-bbd8-9854b63add2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0f4cbbce-eff1-490d-bbd8-9854b63add2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:43.642223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:43.643131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:43.644296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 129/252] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:43.647260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9d69-27e7-4704-a77c-88bbcd70ec12 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.647861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9d69-27e7-4704-a77c-88bbcd70ec12 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.648141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a9d69-27e7-4704-a77c-88bbcd70ec12 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.650749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 130/253] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:43.650749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a9d69-27e7-4704-a77c-88bbcd70ec12 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:43.675217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a07457-1b61-48fe-ac85-ac8ea98750d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:43.676041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07457-1b61-48fe-ac85-ac8ea98750d0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.676422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07457-1b61-48fe-ac85-ac8ea98750d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.676819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a07457-1b61-48fe-ac85-ac8ea98750d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.677949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07457-1b61-48fe-ac85-ac8ea98750d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:43.678338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07457-1b61-48fe-ac85-ac8ea98750d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:43.680809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a07457-1b61-48fe-ac85-ac8ea98750d0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:43.694744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 124/254] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:43.696440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a06b84-24a9-4199-be96-3b773166c9a7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.696732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a06b84-24a9-4199-be96-3b773166c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.697008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a06b84-24a9-4199-be96-3b773166c9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.733636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-88a06b84-24a9-4199-be96-3b773166c9a7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:43.734827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-88a06b84-24a9-4199-be96-3b773166c9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:43.775880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:43.796514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a9d69-27e7-4704-a77c-88bbcd70ec12 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:43.847592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:43.848269 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:43.848553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:43.848829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:43.849586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:43.849894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:43.851324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:43.870870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 131/255] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:43.876866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:43.893298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 125/256] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:43.894089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a06b84-24a9-4199-be96-3b773166c9a7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:43.899565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:44.046718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1038fa5c-def2-4090-a6d2-c910d9f71d90 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:44.082762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:44.083668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:44.083956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:44.084233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] PATH_INFO: `/v3/users/19d145a7110b407e8f0b70867d09ed10` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:44.085430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] RBAC: Authorizing `identity:get_user(user_id=19d145a7110b407e8f0b70867d09ed10)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:44.086938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:44.088574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 132/257] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:43 2022] GET /identity/v3/users/19d145a7110b407e8f0b70867d09ed10 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:44.089326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:44.103797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:44.152841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a06b84-24a9-4199-be96-3b773166c9a7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:44.199411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89ce21-f528-4a9b-87ec-130a5a302d95 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:44.220718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:44.221602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:44.221882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:44.222156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] PATH_INFO: `/v3/users/b994aae98cda4d77870f5ef618026d87` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:44.225017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] RBAC: Authorizing `identity:get_user(user_id=b994aae98cda4d77870f5ef618026d87)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:44.226479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:44.232953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 126/258] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:43 2022] GET /identity/v3/users/b994aae98cda4d77870f5ef618026d87 => generated 297 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:44.233805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:44.265164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:44.266016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:44.266297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:44.266568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:44.288482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:44.296835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:44.297680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 133/259] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:44.298882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:44.389598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:44.417872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:44.426396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cde1b-29fe-4bde-900e-41f96a61237e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:44.464318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:44.465056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:44.465345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:44.465620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:44.504765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c21e8-8f89-4c8b-976b-213909f1c227 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:44.543515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:44.545472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:44.580421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:44.582938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:44.583602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:44.584712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:44.586813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:44.588640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:44.592487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 134/260] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:44 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:44.594058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:44.696277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:44.736486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b1e91-24cd-4ae6-b675-a904573c5df4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:44.752872 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 127/261] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:44.753695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:44.779446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:44.780726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:44.782224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:44.783585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:44.784624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:44.785317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:44.788306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:44.803497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 135/262] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:44.804712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:44.808034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:44.895178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5258dc8-300d-40d0-a64c-0fd6075ad645 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:44.932077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:44.932728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:44.933019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:44.933301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/b994aae98cda4d77870f5ef618026d87/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:44.935361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb2ebcfc1134898824164d20ac1f3a2, user_id=b994aae98cda4d77870f5ef618026d87, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:44.936785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:44.966935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 128/263] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:44 2022] PUT /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/b994aae98cda4d77870f5ef618026d87/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:44.967764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:44.973965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8aa187-7616-4bf3-975b-0b75cacf8bab None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:45.033748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:45.047945 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:45.048829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:45.049120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:45.049397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:45.050711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:45.052284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:45.053982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 136/264] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:44 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:45.062977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:45.178855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:45.184059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254d553-ecb5-4247-87fb-06f6550b8f45 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:45.212493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8d3ba-70c3-4ce2-9d19-2fb72f3e69b2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:45.250280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:45.250886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:45.251193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:45.251462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:45.252305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=19d145a7110b407e8f0b70867d09ed10) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:45.252617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:45.254072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:45.263605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 137/265] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:45 2022] GET /identity/v3/role_assignments?user.id=19d145a7110b407e8f0b70867d09ed10&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:45.266443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889cc9b-109c-4f18-9201-e9b1bf7de8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:45.267396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889cc9b-109c-4f18-9201-e9b1bf7de8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:45.267679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889cc9b-109c-4f18-9201-e9b1bf7de8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:45.267956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889cc9b-109c-4f18-9201-e9b1bf7de8d8 None admin] PATH_INFO: `/v3/users/19d145a7110b407e8f0b70867d09ed10` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:45.269326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889cc9b-109c-4f18-9201-e9b1bf7de8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=19d145a7110b407e8f0b70867d09ed10)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:45.270898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889cc9b-109c-4f18-9201-e9b1bf7de8d8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:45.272902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 129/266] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:44 2022] GET /identity/v3/users/19d145a7110b407e8f0b70867d09ed10 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:45.278400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:45.398289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a441-e5f4-42fd-9702-9cc2078145ea None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:45.437335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:45.438004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:45.438290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:45.438569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:45.441605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:45.515895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:45.517319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:45.600811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3727a-2927-428e-8575-59a714d306f9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:45.601166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3727a-2927-428e-8575-59a714d306f9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:45.601367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3727a-2927-428e-8575-59a714d306f9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:45.603481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 130/267] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:45.609024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd3f-bfc7-4de6-acad-c21783dd4a67 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:45.609320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd3f-bfc7-4de6-acad-c21783dd4a67 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:45.609599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05cd3f-bfc7-4de6-acad-c21783dd4a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:45.633701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 138/268] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:45.641974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8b05cd3f-bfc7-4de6-acad-c21783dd4a67 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:45.642820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:45.643251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8b05cd3f-bfc7-4de6-acad-c21783dd4a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:45.679196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:45.751582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481281a7-0c22-483b-8bc3-1a93c1c6bfa0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:45.768339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 131/269] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:45.789125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:45.790690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:45.791106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:45.791480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:45.792794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:45.794350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:45.796576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 139/270] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:45 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:45.802103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd3f-bfc7-4de6-acad-c21783dd4a67 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:45.811696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:45.863986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:45.964771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b4a2a-cea7-4b32-a82c-34eba782e84c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:45.966379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:45.979569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05cd3f-bfc7-4de6-acad-c21783dd4a67 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:46.005711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1f1c10-c777-4e3c-a888-c32cec0aa457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.007164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1c10-c777-4e3c-a888-c32cec0aa457 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.007917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1c10-c777-4e3c-a888-c32cec0aa457 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.008452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1c10-c777-4e3c-a888-c32cec0aa457 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.019849 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.020451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.020791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.021068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.021961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] RBAC: Adding query filter params (role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=19d145a7110b407e8f0b70867d09ed10) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:46.022320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:46.022826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1f1c10-c777-4e3c-a888-c32cec0aa457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:46.023964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5a1f1c10-c777-4e3c-a888-c32cec0aa457 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:46.031779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:46.032648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:46.033460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 140/271] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:46.034560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9091-3e0d-4e9b-87d1-458f78a8a35d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.034751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9091-3e0d-4e9b-87d1-458f78a8a35d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.037105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 132/272] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:45 2022] GET /identity/v3/role_assignments?user.id=19d145a7110b407e8f0b70867d09ed10&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:46.037561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efa9091-3e0d-4e9b-87d1-458f78a8a35d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.039729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 141/273] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:46.047243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:46.051281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213573a3-651d-472c-9780-b250d8c734d0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.051930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213573a3-651d-472c-9780-b250d8c734d0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.052410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213573a3-651d-472c-9780-b250d8c734d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.096298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-213573a3-651d-472c-9780-b250d8c734d0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:46.097548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-213573a3-651d-472c-9780-b250d8c734d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:46.187161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:46.197717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11072eb-c0e7-4efd-a7d3-b1dab6084c55 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:46.219930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 142/274] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:46.251057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.251746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.252032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.252311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.253077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:46.253387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:46.254765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:46.264018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 133/275] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:46.268141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213573a3-651d-472c-9780-b250d8c734d0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:46.269433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:46.384805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:46.390689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5592-779b-4c33-a4c5-314165fa6eef None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:46.393832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213573a3-651d-472c-9780-b250d8c734d0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:46.426083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.427320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.427599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.427871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] PATH_INFO: `/v3/users/068e1adb6daa46978c8994f4ebd8b8ba` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.431123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb1c9d-f51b-4db3-be1e-803a7ce39a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.431918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1c9d-f51b-4db3-be1e-803a7ce39a2c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.432200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1c9d-f51b-4db3-be1e-803a7ce39a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.432471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb1c9d-f51b-4db3-be1e-803a7ce39a2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.433638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb1c9d-f51b-4db3-be1e-803a7ce39a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:46.435158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb1c9d-f51b-4db3-be1e-803a7ce39a2c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:46.436958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 143/276] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:46.441477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] RBAC: Authorizing `identity:get_user(user_id=068e1adb6daa46978c8994f4ebd8b8ba)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:46.442784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625153-ec00-4b4c-902e-c4c2b458aa10 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.442902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:46.443127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625153-ec00-4b4c-902e-c4c2b458aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.443406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625153-ec00-4b4c-902e-c4c2b458aa10 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.449264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 134/277] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:46 2022] GET /identity/v3/users/068e1adb6daa46978c8994f4ebd8b8ba => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:46.449388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 144/278] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:46.449789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:46.450381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c58af5-1387-4b8b-8c9d-dc3ee1d06a28 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.450670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c58af5-1387-4b8b-8c9d-dc3ee1d06a28 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.450983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c58af5-1387-4b8b-8c9d-dc3ee1d06a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.464659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:46.471211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-18c58af5-1387-4b8b-8c9d-dc3ee1d06a28 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:46.472391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-18c58af5-1387-4b8b-8c9d-dc3ee1d06a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:46.543023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 145/279] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:46.543023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c58af5-1387-4b8b-8c9d-dc3ee1d06a28 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:46.565182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6ff04-7a02-4b9c-9580-7e832ad422e0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:46.601027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.601720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.602009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.602285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.603027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:46.604471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:46.634954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 135/280] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:58:46 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:46.634954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:46.658974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:46.675087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c58af5-1387-4b8b-8c9d-dc3ee1d06a28 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:46.714686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:46.724153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.725130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.725583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.726052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.728838 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, user.id=068e1adb6daa46978c8994f4ebd8b8ba, scope.system=all) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:46.729873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:46.731736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:46.740871 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 146/281] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 19:58:46 2022] GET /identity/v3/role_assignments?user.id=068e1adb6daa46978c8994f4ebd8b8ba&scope.system=all&role.id=2f1a975d114c4307b75105be01055d98 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:46.764964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba48e7e-9dff-49a5-a898-4c524fd53783 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:46.808774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:46.809975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:46.810475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:46.810993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:46.824995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:46.833719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:46.834686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:46.835492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:46.836115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 136/282] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:46.841513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:46.964267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ba21-d3b5-4cd9-9b4c-d7ef2f329931 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:47.004916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:47.005598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:47.005878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:47.006156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:47.006937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:47.007244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:47.008659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:47.017768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 147/283] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:47.024075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:47.169157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2bb4c-4554-4f88-b8d8-c5ad584b2f17 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:47.197801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:47.216329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:47.217595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:47.218076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:47.218564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] PATH_INFO: `/v3/users/2613ac8ef57248118412f944daf209c4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:47.220042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] RBAC: Authorizing `identity:get_user(user_id=2613ac8ef57248118412f944daf209c4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:47.221839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:47.224143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 137/284] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:47 2022] GET /identity/v3/users/2613ac8ef57248118412f944daf209c4 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:47.232016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:47.266892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:47.396691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06429d7a-6ae8-4e1d-909d-c585b8e3fb3d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:47.447640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f755e877-a1cd-4159-b15f-4a7ab2951511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:47.448530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e877-a1cd-4159-b15f-4a7ab2951511 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:47.448821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e877-a1cd-4159-b15f-4a7ab2951511 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:47.449095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f755e877-a1cd-4159-b15f-4a7ab2951511 None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:47.450351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755e877-a1cd-4159-b15f-4a7ab2951511 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:47.451853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f755e877-a1cd-4159-b15f-4a7ab2951511 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:47.453889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 148/285] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:47 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:47.459710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:47.585433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a9793-13be-497d-b2ad-252ae25d5587 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:47.629896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10158f76-dc77-46f2-b141-6cf49f9a207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:47.630823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158f76-dc77-46f2-b141-6cf49f9a207c None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:47.631140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158f76-dc77-46f2-b141-6cf49f9a207c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:47.631421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10158f76-dc77-46f2-b141-6cf49f9a207c None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/2613ac8ef57248118412f944daf209c4/roles/c39f354dff1b4eeb81a60bd4bc806c70` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:47.633497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10158f76-dc77-46f2-b141-6cf49f9a207c None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb2ebcfc1134898824164d20ac1f3a2, user_id=2613ac8ef57248118412f944daf209c4, role_id=c39f354dff1b4eeb81a60bd4bc806c70)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:47.634990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10158f76-dc77-46f2-b141-6cf49f9a207c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:47.656383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 138/286] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:58:47 2022] PUT /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/users/2613ac8ef57248118412f944daf209c4/roles/c39f354dff1b4eeb81a60bd4bc806c70 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:48.109397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87344-eefd-4ace-8c78-8e1694f6155a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:48.109931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87344-eefd-4ace-8c78-8e1694f6155a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:48.109931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87344-eefd-4ace-8c78-8e1694f6155a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:48.111372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 149/287] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:48.117769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f66a9-48b5-432a-b6cb-d4b6d9c09e2f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:48.118253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f66a9-48b5-432a-b6cb-d4b6d9c09e2f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:48.118352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f66a9-48b5-432a-b6cb-d4b6d9c09e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:48.137217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-be2f66a9-48b5-432a-b6cb-d4b6d9c09e2f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:48.138752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-be2f66a9-48b5-432a-b6cb-d4b6d9c09e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:48.219120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:48.242194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 139/288] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:48.288317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87344-eefd-4ace-8c78-8e1694f6155a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:48.422289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:48.440831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87344-eefd-4ace-8c78-8e1694f6155a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:48.488968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:48.489819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:48.490113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:48.490388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:48.501382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:48.509450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:48.510310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:48.511116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 150/289] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:48.516463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f66a9-48b5-432a-b6cb-d4b6d9c09e2f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:48.649609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f66a9-48b5-432a-b6cb-d4b6d9c09e2f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:48.690393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:48.691020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:48.691303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:48.691578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:48.692330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:48.692638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:48.694004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:48.707454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 140/290] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:48.713306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:48.875677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17050d71-f137-46e4-91ed-c479274ceaec None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:48.915561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:48.916803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:48.917309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:48.917781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] PATH_INFO: `/v3/users/b994aae98cda4d77870f5ef618026d87` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:48.919221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=b994aae98cda4d77870f5ef618026d87)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:48.920869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:48.923019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 151/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:48 2022] GET /identity/v3/users/b994aae98cda4d77870f5ef618026d87 => generated 297 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:48.930951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:49.006183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:49.071326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f38541-4743-4ea4-8a54-63067be55a48 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:49.120187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dfceb-e242-436f-808b-7543b4ac73ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:49.121282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfceb-e242-436f-808b-7543b4ac73ca None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.121763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfceb-e242-436f-808b-7543b4ac73ca None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.122222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfceb-e242-436f-808b-7543b4ac73ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.224088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dfceb-e242-436f-808b-7543b4ac73ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:49.225621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dfceb-e242-436f-808b-7543b4ac73ca None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:49.289349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:49.370962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 141/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:49.378011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:49.397639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:49.448694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaca0f-3d37-4df6-887f-1e80b7ac2765 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.449146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaca0f-3d37-4df6-887f-1e80b7ac2765 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.449566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceaca0f-3d37-4df6-887f-1e80b7ac2765 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.452226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 142/293] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:49.458503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db42c64-5dd0-4ffc-a558-48f88e925ae4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.459018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db42c64-5dd0-4ffc-a558-48f88e925ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.459509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db42c64-5dd0-4ffc-a558-48f88e925ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.506867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14303fb-252a-475e-9f16-1b01300df1b9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:49.516608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5db42c64-5dd0-4ffc-a558-48f88e925ae4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:49.518122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5db42c64-5dd0-4ffc-a558-48f88e925ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:49.543942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:49.544746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.545126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.545410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.546651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:49.555271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:49.555271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 152/294] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:49 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:49.558872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:49.672096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 143/295] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:49.674650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9362385-19bc-41a4-a182-e18d11f65603 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.676006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9362385-19bc-41a4-a182-e18d11f65603 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.676490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9362385-19bc-41a4-a182-e18d11f65603 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.678162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 144/296] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:49.685775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936807d-97be-4d26-8f15-b7ca6cd92a7a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.687158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936807d-97be-4d26-8f15-b7ca6cd92a7a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.690350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936807d-97be-4d26-8f15-b7ca6cd92a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.720202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b936807d-97be-4d26-8f15-b7ca6cd92a7a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:49.722917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b936807d-97be-4d26-8f15-b7ca6cd92a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:49.748869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:49.780913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedba657-fe6d-4d3e-be47-1ba1c8a2a69d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:49.814924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 145/297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:49.816137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936807d-97be-4d26-8f15-b7ca6cd92a7a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:49.835400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9a24-f73a-46e9-a406-f2832c972caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:49.836415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9a24-f73a-46e9-a406-f2832c972caf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.836853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9a24-f73a-46e9-a406-f2832c972caf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.837308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9a24-f73a-46e9-a406-f2832c972caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.838291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9a24-f73a-46e9-a406-f2832c972caf None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=b994aae98cda4d77870f5ef618026d87) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:49.838768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9a24-f73a-46e9-a406-f2832c972caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:49.842820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9a24-f73a-46e9-a406-f2832c972caf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:49.845882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:49.851411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 153/298] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:49 2022] GET /identity/v3/role_assignments?user.id=b994aae98cda4d77870f5ef618026d87&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=2f1a975d114c4307b75105be01055d98 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:49.857413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daee31-90fe-4942-a0a1-96edd9c76d61 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:49.857413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daee31-90fe-4942-a0a1-96edd9c76d61 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:49.857413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daee31-90fe-4942-a0a1-96edd9c76d61 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:49.859005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 154/299] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:49.859936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daee31-90fe-4942-a0a1-96edd9c76d61 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:49.963693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936807d-97be-4d26-8f15-b7ca6cd92a7a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.009169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de7afc-19c0-43cd-b51b-d3adc846ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.010227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7afc-19c0-43cd-b51b-d3adc846ff1c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.010519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7afc-19c0-43cd-b51b-d3adc846ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.012278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de7afc-19c0-43cd-b51b-d3adc846ff1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.034020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de7afc-19c0-43cd-b51b-d3adc846ff1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b6de7afc-19c0-43cd-b51b-d3adc846ff1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:50.050002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:50.050965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:50.052346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 146/300] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:50.053015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c3756-4d9f-4e64-bae5-3f5fba3478af None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.053263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c3756-4d9f-4e64-bae5-3f5fba3478af None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.053410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c3756-4d9f-4e64-bae5-3f5fba3478af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.081293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6d5c3756-4d9f-4e64-bae5-3f5fba3478af None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:50.082576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6d5c3756-4d9f-4e64-bae5-3f5fba3478af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:50.118674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daee31-90fe-4942-a0a1-96edd9c76d61 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.167198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:50.168872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.170041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.170650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.171168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.171661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 147/301] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:50.172490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c3756-4d9f-4e64-bae5-3f5fba3478af None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.173371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:50.175352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:50.183127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 155/302] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:50.184564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.206028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:50.284624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c3756-4d9f-4e64-bae5-3f5fba3478af None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.303794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f76a-9779-46eb-b56e-3cc5b3d671fb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.323970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.324649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.324937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.325222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.326404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:50.326404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:50.327686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:50.337118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 148/303] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:50.337884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.342112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.342879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.343157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.343433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] PATH_INFO: `/v3/groups` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.344126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:50.345543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:50.363036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 156/304] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 26 19:58:50 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:58:50.363858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.415707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:50.457264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:50.462262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b6349-04be-47fc-943e-570a33a74788 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.499483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb70de4-c135-4fe5-9de2-6b3cf8a0e399 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.515267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714c261-3674-4239-a10f-30c434db6d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.516747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c261-3674-4239-a10f-30c434db6d77 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.517236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c261-3674-4239-a10f-30c434db6d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.517845 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714c261-3674-4239-a10f-30c434db6d77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.534416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714c261-3674-4239-a10f-30c434db6d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:50.536159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383a30c-13eb-4029-9d79-200f62de6337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.537055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a30c-13eb-4029-9d79-200f62de6337 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.537338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a30c-13eb-4029-9d79-200f62de6337 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.537613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383a30c-13eb-4029-9d79-200f62de6337 None admin] PATH_INFO: `/v3/users/068e1adb6daa46978c8994f4ebd8b8ba` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383a30c-13eb-4029-9d79-200f62de6337 None admin] RBAC: Authorizing `identity:get_user(user_id=068e1adb6daa46978c8994f4ebd8b8ba)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:50.540400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383a30c-13eb-4029-9d79-200f62de6337 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:50.542265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 157/305] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:50 2022] GET /identity/v3/users/068e1adb6daa46978c8994f4ebd8b8ba => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:50.543445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b867e-dbef-47ad-8912-ad4e4052f9a5 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.543733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b867e-dbef-47ad-8912-ad4e4052f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.544011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b867e-dbef-47ad-8912-ad4e4052f9a5 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.545298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 158/306] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-3714c261-3674-4239-a10f-30c434db6d77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:50.546253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:50.551612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:50.552400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:50.553005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b867e-dbef-47ad-8912-ad4e4052f9a5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.553076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 149/307] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:50.553076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b84af-8c5d-4f26-a908-0cb089790f57 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.553076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b84af-8c5d-4f26-a908-0cb089790f57 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.553076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b84af-8c5d-4f26-a908-0cb089790f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.572294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-687b84af-8c5d-4f26-a908-0cb089790f57 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:50.573497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-687b84af-8c5d-4f26-a908-0cb089790f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:50.651854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 150/308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:50.652700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b84af-8c5d-4f26-a908-0cb089790f57 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.672848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b867e-dbef-47ad-8912-ad4e4052f9a5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.709698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db270-e133-4652-868f-f3f082fec00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.710949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db270-e133-4652-868f-f3f082fec00c None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.711852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db270-e133-4652-868f-f3f082fec00c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.712127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448db270-e133-4652-868f-f3f082fec00c None admin] PATH_INFO: `/v3/system/users/068e1adb6daa46978c8994f4ebd8b8ba/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.713003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:50.713589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448db270-e133-4652-868f-f3f082fec00c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=068e1adb6daa46978c8994f4ebd8b8ba, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:50.714990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448db270-e133-4652-868f-f3f082fec00c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:50.724540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 159/309] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 26 19:58:50 2022] PUT /identity/v3/system/users/068e1adb6daa46978c8994f4ebd8b8ba/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:50.725897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db270-e133-4652-868f-f3f082fec00c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.737596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:50.780114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b84af-8c5d-4f26-a908-0cb089790f57 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.819609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.820623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.821489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.821770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.822556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:50.823042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:50.824470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:50.838320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 151/310] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:50.840039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:50.887514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448db270-e133-4652-868f-f3f082fec00c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.939755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:50.940950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:50.941878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:50.942366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:50.956997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:50.961516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfde0f2-af3d-471c-936a-40b1d0a0921d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:50.964991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:50.965880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:50.974692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 160/311] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:50.978820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:50.980260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:51.006526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:51.008740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:51.009199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:51.010069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] PATH_INFO: `/v3/users/06b8e8d3944246c4bb95e5fc91a2bba5` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:51.028558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] RBAC: Authorizing `identity:get_user(user_id=06b8e8d3944246c4bb95e5fc91a2bba5)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:51.030643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:51.033340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 152/312] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:50 2022] GET /identity/v3/users/06b8e8d3944246c4bb95e5fc91a2bba5 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:51.040368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:51.053071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:51.097365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c07107f-7a32-4f8e-95ba-02ed5f2c8b74 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:51.136029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:51.136264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:51.136435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:51.136859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:51.137732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:51.138054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:51.139535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:51.154305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 161/313] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:51.154553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:51.182040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b777ca-18a6-4b2c-ba08-8e4c0e76caa8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:51.230668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:51.231693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:51.232339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:51.232789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:51.234356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] RBAC: Adding query filter params (role.id=c39f354dff1b4eeb81a60bd4bc806c70, user.id=06b8e8d3944246c4bb95e5fc91a2bba5, scope.system=all) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:51.235122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:51.237868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:51.244963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 153/314] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 19:58:51 2022] GET /identity/v3/role_assignments?user.id=06b8e8d3944246c4bb95e5fc91a2bba5&scope.system=all&role.id=c39f354dff1b4eeb81a60bd4bc806c70 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:51.273389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95b251-813c-4500-ab41-fde90117797b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:51.303531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:51.314260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:51.315206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:51.315494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:51.315772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] PATH_INFO: `/v3/users/2613ac8ef57248118412f944daf209c4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:51.317038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] RBAC: Authorizing `identity:get_user(user_id=2613ac8ef57248118412f944daf209c4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:51.318589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:51.321262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 162/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:51 2022] GET /identity/v3/users/2613ac8ef57248118412f944daf209c4 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:51.327526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:51.364792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:51.438778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc5e3d-d441-4caa-8624-2ecce3724059 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:51.483170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:51.484163 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:51.484684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:51.485141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:51.561177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:51.562959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:51.598999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:51.672890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 154/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:58:51.678566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:51.784642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6a767-e0fb-4780-9ffb-f205a0b8e320 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:51.819947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89142374-f4a8-401f-aee0-38080638048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:51.821345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142374-f4a8-401f-aee0-38080638048f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:51.821776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142374-f4a8-401f-aee0-38080638048f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:51.822198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89142374-f4a8-401f-aee0-38080638048f None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:51.823632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142374-f4a8-401f-aee0-38080638048f None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:51.825309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89142374-f4a8-401f-aee0-38080638048f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:51.827353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 163/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:51 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:51.833255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:51.941615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1c7f3-ab67-4be2-beed-5985d22885b6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:51.978706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bffd43-db53-4d76-8312-f1da3b1be6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:51.979662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bffd43-db53-4d76-8312-f1da3b1be6aa None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:51.980098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bffd43-db53-4d76-8312-f1da3b1be6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:51.980524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bffd43-db53-4d76-8312-f1da3b1be6aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:51.981581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bffd43-db53-4d76-8312-f1da3b1be6aa None admin] RBAC: Adding query filter params (role.id=c39f354dff1b4eeb81a60bd4bc806c70, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2, user.id=2613ac8ef57248118412f944daf209c4) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:51.982078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bffd43-db53-4d76-8312-f1da3b1be6aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:51.983692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bffd43-db53-4d76-8312-f1da3b1be6aa None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:51.985816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:51.991223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 155/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:58:51 2022] GET /identity/v3/role_assignments?user.id=2613ac8ef57248118412f944daf209c4&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=c39f354dff1b4eeb81a60bd4bc806c70 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:52.637369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a575834-c127-4e07-8867-0aabe9128fb7 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:52.637665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a575834-c127-4e07-8867-0aabe9128fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:52.637945 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a575834-c127-4e07-8867-0aabe9128fb7 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:52.639363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 164/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:52.644565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9daa-2ec9-4cb0-8027-f3e7a019db34 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:52.644978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9daa-2ec9-4cb0-8027-f3e7a019db34 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:52.645147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc9daa-2ec9-4cb0-8027-f3e7a019db34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:52.661803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fedc9daa-2ec9-4cb0-8027-f3e7a019db34 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:52.663014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fedc9daa-2ec9-4cb0-8027-f3e7a019db34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:52.732175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 156/320] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:52.754549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a575834-c127-4e07-8867-0aabe9128fb7 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:52.817392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:52.862545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a575834-c127-4e07-8867-0aabe9128fb7 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:52.896217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c155d0-9ee3-4b7e-8640-621481c014b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:52.896931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c155d0-9ee3-4b7e-8640-621481c014b5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:52.897212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c155d0-9ee3-4b7e-8640-621481c014b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:52.897486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c155d0-9ee3-4b7e-8640-621481c014b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:52.898679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c155d0-9ee3-4b7e-8640-621481c014b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:52.900142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c155d0-9ee3-4b7e-8640-621481c014b5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:52.901902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 165/321] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:52.907272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9daa-2ec9-4cb0-8027-f3e7a019db34 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:53.007203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc9daa-2ec9-4cb0-8027-f3e7a019db34 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:53.021793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5c8b6-4be7-4916-bee0-34d313cf956b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.022077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5c8b6-4be7-4916-bee0-34d313cf956b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.022353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5c8b6-4be7-4916-bee0-34d313cf956b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.024467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 166/322] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:53.029162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9664f8-456c-4263-98ad-6cff8e889038 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.029444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9664f8-456c-4263-98ad-6cff8e889038 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.029716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9664f8-456c-4263-98ad-6cff8e889038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.035220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:53.045012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:53.045690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.045979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.046257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] PATH_INFO: `/v3/groups` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.046994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:53.047423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6d9664f8-456c-4263-98ad-6cff8e889038 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:53.048439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:53.048609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6d9664f8-456c-4263-98ad-6cff8e889038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:53.071158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 157/323] 10.222.0.48 () {60 vars in 1134 bytes} [Thu May 26 19:58:52 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:58:53.123236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 167/324] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:53.146379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:53.255940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1129-7de3-4b24-a5ed-e38c2c64049d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:53.291853 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517905f0-8a90-4f6f-9ccc-8149b062ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:53.292692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517905f0-8a90-4f6f-9ccc-8149b062ab7c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.292976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517905f0-8a90-4f6f-9ccc-8149b062ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.293254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517905f0-8a90-4f6f-9ccc-8149b062ab7c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.305446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517905f0-8a90-4f6f-9ccc-8149b062ab7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-517905f0-8a90-4f6f-9ccc-8149b062ab7c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:53.313472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:53.314426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:53.315258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 158/325] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:53.322464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9664f8-456c-4263-98ad-6cff8e889038 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:53.389069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:53.433949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9664f8-456c-4263-98ad-6cff8e889038 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:53.470224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:53.470918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.471199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.471467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.472215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:53.472513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:53.473874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:53.483120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 168/326] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:53.484115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38afc-8615-4b8a-986f-c3b90eab6e9e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.484409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38afc-8615-4b8a-986f-c3b90eab6e9e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.484690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c38afc-8615-4b8a-986f-c3b90eab6e9e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.486176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 159/327] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:53.488062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:53.491026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d56c17-5be7-454f-bf9a-adc623943949 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.491321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d56c17-5be7-454f-bf9a-adc623943949 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.491598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d56c17-5be7-454f-bf9a-adc623943949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.511180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b3d56c17-5be7-454f-bf9a-adc623943949 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:53.512383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b3d56c17-5be7-454f-bf9a-adc623943949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:53.569319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:53.605310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 160/328] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:53.611875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee54aa4-b831-44ed-95e1-3084acd945de None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:53.631037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d56c17-5be7-454f-bf9a-adc623943949 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:53.636470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:53.653690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:53.654620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.655024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.655334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] PATH_INFO: `/v3/users/068e1adb6daa46978c8994f4ebd8b8ba` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.656625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] RBAC: Authorizing `identity:get_user(user_id=068e1adb6daa46978c8994f4ebd8b8ba)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:53.658113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:53.660122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 169/329] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:53 2022] GET /identity/v3/users/068e1adb6daa46978c8994f4ebd8b8ba => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:53.666062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:53.789221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82873796-b48b-44eb-8bdd-62f88980867f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:53.789802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d56c17-5be7-454f-bf9a-adc623943949 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:53.828872 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:53.829551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:53.829672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.829963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.830237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.830985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:53.831551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:53.832125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:53.833315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] RBAC: Adding query filter params (role.id=2f1a975d114c4307b75105be01055d98, user.id=068e1adb6daa46978c8994f4ebd8b8ba, scope.system=all) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:53.833862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:53.835563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:53.843682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:53.849416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 170/330] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 19:58:53 2022] GET /identity/v3/role_assignments?user.id=068e1adb6daa46978c8994f4ebd8b8ba&scope.system=all&role.id=2f1a975d114c4307b75105be01055d98 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:53.851915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:53.852775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:53.853560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 161/331] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:58:53.860761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:53.917578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:53.978044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58371b-b167-48e8-a26e-a557bca54617 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:54.016058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:54.017072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:54.017602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:54.018081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:54.019070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:54.019575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:54.021158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:54.030937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 171/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:54.037151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:54.094352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:54.173040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b3cb-399a-478b-a95f-dbc566c0b883 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:54.211487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b08fcd-8fff-4917-8208-f90ea3bd559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:54.212381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08fcd-8fff-4917-8208-f90ea3bd559c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:54.212669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08fcd-8fff-4917-8208-f90ea3bd559c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:54.212949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b08fcd-8fff-4917-8208-f90ea3bd559c None admin] PATH_INFO: `/v3/users/06b8e8d3944246c4bb95e5fc91a2bba5` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:54.214182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b08fcd-8fff-4917-8208-f90ea3bd559c None admin] RBAC: Authorizing `identity:get_user(user_id=06b8e8d3944246c4bb95e5fc91a2bba5)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:54.215680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b08fcd-8fff-4917-8208-f90ea3bd559c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:54.217699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 162/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:54 2022] GET /identity/v3/users/06b8e8d3944246c4bb95e5fc91a2bba5 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:58:54.223276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:54.340733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046723e-60dc-4f70-8490-3a31dbc912db None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:54.352502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:54.380241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17f7e3-d445-4b58-bc4e-00f04dc63b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:54.381369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f7e3-d445-4b58-bc4e-00f04dc63b26 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:54.381812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f7e3-d445-4b58-bc4e-00f04dc63b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:54.382245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17f7e3-d445-4b58-bc4e-00f04dc63b26 None admin] PATH_INFO: `/v3/system/users/06b8e8d3944246c4bb95e5fc91a2bba5/roles/c39f354dff1b4eeb81a60bd4bc806c70` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:54.384074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17f7e3-d445-4b58-bc4e-00f04dc63b26 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=06b8e8d3944246c4bb95e5fc91a2bba5, role_id=c39f354dff1b4eeb81a60bd4bc806c70)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:54.385683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17f7e3-d445-4b58-bc4e-00f04dc63b26 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:54.396091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 172/334] 10.222.0.48 () {58 vars in 1334 bytes} [Thu May 26 19:58:54 2022] PUT /identity/v3/system/users/06b8e8d3944246c4bb95e5fc91a2bba5/roles/c39f354dff1b4eeb81a60bd4bc806c70 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:58:56.267787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f1e0-bf49-4197-8195-7e81a9ba4cdc None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.268805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f1e0-bf49-4197-8195-7e81a9ba4cdc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.269319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28f1e0-bf49-4197-8195-7e81a9ba4cdc None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.271202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 163/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:56.276822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd3e6-1f78-4333-bc84-6d727b3a06a6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.277267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd3e6-1f78-4333-bc84-6d727b3a06a6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.277360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd3e6-1f78-4333-bc84-6d727b3a06a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.304158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-59cdd3e6-1f78-4333-bc84-6d727b3a06a6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:56.305401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-59cdd3e6-1f78-4333-bc84-6d727b3a06a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:56.359651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a204ed-d2bb-4fea-8892-0d9e823e5d68 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.361198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a204ed-d2bb-4fea-8892-0d9e823e5d68 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.361695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a204ed-d2bb-4fea-8892-0d9e823e5d68 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.363585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 164/336] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:56.370075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0972e-892c-4733-a830-ad79787ac45f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.370825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0972e-892c-4733-a830-ad79787ac45f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.371452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf0972e-892c-4733-a830-ad79787ac45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.398092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-acf0972e-892c-4733-a830-ad79787ac45f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:56.404751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-acf0972e-892c-4733-a830-ad79787ac45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:56.420511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 173/337] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:56.461319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f9d1-1b79-4d6c-a502-b90cd6a9c396 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.461668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f9d1-1b79-4d6c-a502-b90cd6a9c396 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.461878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2f9d1-1b79-4d6c-a502-b90cd6a9c396 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.463868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 174/338] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:58:56.476339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55c9d-10fa-4a06-941a-8149315aaa5c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.476652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55c9d-10fa-4a06-941a-8149315aaa5c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.476893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a55c9d-10fa-4a06-941a-8149315aaa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.504968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 165/339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:58:56.505976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0972e-892c-4733-a830-ad79787ac45f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:56.513687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-75a55c9d-10fa-4a06-941a-8149315aaa5c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:56.514895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-75a55c9d-10fa-4a06-941a-8149315aaa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:56.600943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:56.620637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 175/340] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:56.621952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a55c9d-10fa-4a06-941a-8149315aaa5c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:56.664597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:56.749329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a55c9d-10fa-4a06-941a-8149315aaa5c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:56.753472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf0972e-892c-4733-a830-ad79787ac45f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:56.789321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:56.790726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.791250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.791673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.805206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:56.813887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:56.815037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:56.816066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:56.818462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 176/341] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:56.819449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:56.833959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:56.834784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.835094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.835395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.852330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:56.865105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:56.866199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:56.867708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 166/342] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:56.868360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:56.926629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:56.934243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89139631-7d89-4236-9433-5ee97a47f2e0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:56.971231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:56.972373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:56.972856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:56.973289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:56.985152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:56.995008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:56.996150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:56.997070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:56.999651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 177/343] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:57.000686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:57.032322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:57.039306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb3f65-a433-4787-aea9-ce5f12044c15 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:57.098326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db500-23de-4db4-90df-23565c63c94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:57.099205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db500-23de-4db4-90df-23565c63c94d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.099600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db500-23de-4db4-90df-23565c63c94d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.099979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820db500-23de-4db4-90df-23565c63c94d None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.101071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db500-23de-4db4-90df-23565c63c94d None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:57.101269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db500-23de-4db4-90df-23565c63c94d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:57.102997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820db500-23de-4db4-90df-23565c63c94d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:57.116284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 167/344] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:57.117833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db500-23de-4db4-90df-23565c63c94d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:57.118180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af3340-1404-414e-883f-30cdb686bc89 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:57.161035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:57.163517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.164645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.165092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.165992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:57.167496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:57.169311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:57.186364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 178/345] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:57.189538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:57.247218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:57.295016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820db500-23de-4db4-90df-23565c63c94d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:57.334539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821cb61d-2116-46e4-9123-fb3fdd6aa6c0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:57.338479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:57.339421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.339889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.340360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.341313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:57.341802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:57.343839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:57.357909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 168/346] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:57.359042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:57.375277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245b141-e6ab-4a91-9fe2-dc346c53fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:57.375867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245b141-e6ab-4a91-9fe2-dc346c53fd17 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.376155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245b141-e6ab-4a91-9fe2-dc346c53fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.376430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245b141-e6ab-4a91-9fe2-dc346c53fd17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.389387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:57.461312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245b141-e6ab-4a91-9fe2-dc346c53fd17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:57.462769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0245b141-e6ab-4a91-9fe2-dc346c53fd17 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:57.495161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:57.499027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531b833-bdc3-4c2a-b3f9-0b6fede00f8b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:57.544423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:57.545056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.545340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.545618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.615445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 179/347] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:57.617346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901afaa9-bdc6-4e91-b7e1-102fe02416c4 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.617945 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901afaa9-bdc6-4e91-b7e1-102fe02416c4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.618427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901afaa9-bdc6-4e91-b7e1-102fe02416c4 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.621922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 180/348] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:57.623015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901afaa9-bdc6-4e91-b7e1-102fe02416c4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:57.629543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:57.631066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:57.654019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:57.741165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901afaa9-bdc6-4e91-b7e1-102fe02416c4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:57.743185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 169/349] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:57.744787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:57.761285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:57.783898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:57.785215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.785712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.786196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.865254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ff60-c28b-48fb-a38b-3dd7c63ef3da None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:57.876790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:57.878519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:57.894729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:57.912938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80bc35-6b43-44bc-9e75-5c99227f068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:57.913982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80bc35-6b43-44bc-9e75-5c99227f068b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.914265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80bc35-6b43-44bc-9e75-5c99227f068b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.914539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80bc35-6b43-44bc-9e75-5c99227f068b None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.915927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80bc35-6b43-44bc-9e75-5c99227f068b None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:57.918225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80bc35-6b43-44bc-9e75-5c99227f068b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:57.922256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 170/350] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:57 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:57.923823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5ece0-d72e-44c6-ba72-e0e4e638d059 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:57.924326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5ece0-d72e-44c6-ba72-e0e4e638d059 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:57.924795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd5ece0-d72e-44c6-ba72-e0e4e638d059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:57.947664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7dd5ece0-d72e-44c6-ba72-e0e4e638d059 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:57.949543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7dd5ece0-d72e-44c6-ba72-e0e4e638d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:58.005151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 181/351] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:58.005925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.028931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:58.040308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 171/352] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:58.042485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac3c10-08a6-4450-8cd3-4b260d55971c None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.042989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac3c10-08a6-4450-8cd3-4b260d55971c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.043405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac3c10-08a6-4450-8cd3-4b260d55971c None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.045043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 172/353] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:58.045875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac3c10-08a6-4450-8cd3-4b260d55971c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.152068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a248f2-7368-48c3-b451-98ef57cc431f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.191621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.192741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.193154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.193591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.194863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac3c10-08a6-4450-8cd3-4b260d55971c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.194986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:58.197276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:58.199292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 182/354] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:58.202868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.219263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:58.241262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9453f-ac8f-4611-aff5-b334e4cc7b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.242674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9453f-ac8f-4611-aff5-b334e4cc7b98 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.242999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9453f-ac8f-4611-aff5-b334e4cc7b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.243589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9453f-ac8f-4611-aff5-b334e4cc7b98 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.251234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9453f-ac8f-4611-aff5-b334e4cc7b98 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:58.252712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9453f-ac8f-4611-aff5-b334e4cc7b98 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:58.254644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 173/355] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:58.255640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cff1-3be8-45f8-ab85-5774e0aff35c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.255933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cff1-3be8-45f8-ab85-5774e0aff35c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.256759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5cff1-3be8-45f8-ab85-5774e0aff35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.276200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cea5cff1-3be8-45f8-ab85-5774e0aff35c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:58.277300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cea5cff1-3be8-45f8-ab85-5774e0aff35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:58.318892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:58.341411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d09a5-471c-4782-847d-211a5e8f322e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.364045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 174/356] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:58.365064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5cff1-3be8-45f8-ab85-5774e0aff35c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.379746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.380632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.380911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.381174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.382360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:58.384459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:58.386316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 183/357] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:58.387771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.495265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5cff1-3be8-45f8-ab85-5774e0aff35c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.503720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1648176-eed3-4b97-a445-13016a661370 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.511448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:58.540759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5effc49-6384-4498-a2f7-baf16604b45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.541576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effc49-6384-4498-a2f7-baf16604b45e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.541856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effc49-6384-4498-a2f7-baf16604b45e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.544016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5effc49-6384-4498-a2f7-baf16604b45e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.546108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.546534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.546818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.547119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.548403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:58.549854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:58.553890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 184/358] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:58.553890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.558402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5effc49-6384-4498-a2f7-baf16604b45e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d5effc49-6384-4498-a2f7-baf16604b45e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:58.567391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:58.568295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:58.569223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 175/359] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:58.569859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f576-b6a5-4c8a-8bf1-00b07e468a8d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.570991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f576-b6a5-4c8a-8bf1-00b07e468a8d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.571244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506f576-b6a5-4c8a-8bf1-00b07e468a8d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.576785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 176/360] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:58:58.577609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506f576-b6a5-4c8a-8bf1-00b07e468a8d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.582309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:58.676483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30c5b-2cf0-4092-bfd1-83b4a43b6687 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.712073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506f576-b6a5-4c8a-8bf1-00b07e468a8d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.717327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.717990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.718270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.718539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.719392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=cc54ff0c5398464b9c085152fd7db90e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:58.720144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:58.721934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:58.729655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 185/361] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=2f1a975d114c4307b75105be01055d98 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:58.730473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.764855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.765607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.765905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.766177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.779155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:58.787308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:58.788459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:58:58.789818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:58:58.791928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 177/362] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:58.793264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.841938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:58.845469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:58.874613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2219-26b2-43e8-b2ed-afc970b4d8e3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:58.928493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:58.930053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:58.930347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:58.930622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:58.931863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:58.933431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:58.935424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 186/363] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:58.936330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:58.947789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1410-9441-42e2-9e0c-d93ec8e05ce3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.001555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc3ff-bd57-4a08-af77-fc0a00d39f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.002503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc3ff-bd57-4a08-af77-fc0a00d39f21 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.002793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc3ff-bd57-4a08-af77-fc0a00d39f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.003106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc3ff-bd57-4a08-af77-fc0a00d39f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.004417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc3ff-bd57-4a08-af77-fc0a00d39f21 None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:59.004746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc3ff-bd57-4a08-af77-fc0a00d39f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.006190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc3ff-bd57-4a08-af77-fc0a00d39f21 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:59.016914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 178/364] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=2f1a975d114c4307b75105be01055d98 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:59.018748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182628bf-95d7-433d-a68f-16a7b7577a08 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.019070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182628bf-95d7-433d-a68f-16a7b7577a08 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.019355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182628bf-95d7-433d-a68f-16a7b7577a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.037757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-182628bf-95d7-433d-a68f-16a7b7577a08 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:58:59.039585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-182628bf-95d7-433d-a68f-16a7b7577a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:58:59.073490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1d827-5525-4216-b53c-67a34c41f66c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.120141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 179/365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:58:59.120979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.121104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182628bf-95d7-433d-a68f-16a7b7577a08 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.122049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.122550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.123200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.124156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:59.124710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.126308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:59.136267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 187/366] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:58:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:59.137499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.159235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:59.159441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:59.259611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182628bf-95d7-433d-a68f-16a7b7577a08 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.281848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070d970-4b5d-4bc4-bf35-4135928cadf8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.321558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.322714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.323650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.323936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.324997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:59.325358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.326753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:59.328272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.329020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.329372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.329718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.330620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=cc54ff0c5398464b9c085152fd7db90e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:59.333162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.334646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:59.336930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 180/367] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:59.337887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.347373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 188/368] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:59.348345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.450139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:59.466953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3596fed9-e1f0-421d-8836-e3ef49ffdf1f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.508672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.509589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.509877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.510161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.553112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:59.586642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc55ae3a-9e3a-4a7c-851d-b23fc7417051 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.590355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.592513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:59.647547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.648938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.649220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.649493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.666062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:58:59.675620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:58:59.676514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:58:59.677284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:58:59.679116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 189/369] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:58:59.680235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.703700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:59.719309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 181/370] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:58:59.720263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.800493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40c33a-8b31-4a15-bfee-eba973336bb4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.830388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f2798-b3aa-43ae-af38-04d8137b05e7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.838303 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.839214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.839499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.839776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] PATH_INFO: `/v3/users/06b8e8d3944246c4bb95e5fc91a2bba5` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.841098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] RBAC: Authorizing `identity:get_user(user_id=06b8e8d3944246c4bb95e5fc91a2bba5)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.842649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:59.844780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 190/371] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/users/06b8e8d3944246c4bb95e5fc91a2bba5 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:59.845768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.856076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:59.868316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.868995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.869277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.869552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.870421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:58:59.870734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.872149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:58:59.881281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 182/372] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:58:59.882085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:58:59.941116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:58:59.956158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475366ee-4593-47d2-a526-200e8606f28f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:58:59.993734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:58:59.994609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:58:59.994926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:58:59.995201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:58:59.996668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:58:59.999126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:00.001031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 191/373] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:00.001712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:00.006060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79de781-4c43-4638-a547-6ec5e74a7d4b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:00.064357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:00.065033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:00.065317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:00.065596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:00.066597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] RBAC: Adding query filter params (role.id=c39f354dff1b4eeb81a60bd4bc806c70, user.id=06b8e8d3944246c4bb95e5fc91a2bba5, scope.system=all) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:00.067040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:00.068554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:00.092240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:00.096667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 183/374] 10.222.0.48 () {56 vars in 1308 bytes} [Thu May 26 19:58:59 2022] GET /identity/v3/role_assignments?user.id=06b8e8d3944246c4bb95e5fc91a2bba5&scope.system=all&role.id=c39f354dff1b4eeb81a60bd4bc806c70 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:00.097845 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:00.153529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a6afe8-4805-47da-8f95-e626f9928b1a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:00.197056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:00.197056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:00.197056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:00.197404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:00.280937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7267a0-2493-41d7-bb4e-8a513237e7c9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:00.301618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:00.303105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:00.303687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:00.321614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:00.322674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:00.323240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:00.323710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:00.327884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:00.329640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:00.331730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 184/375] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:00 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:00.337369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:00.425627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:00.450939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ef78f-c8d2-4e71-a232-0e32ca96e8d6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:00.457363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 192/376] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:00.469501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:00.509931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:00.510655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:00.510970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:00.511252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:00.512105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:00.512420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:00.513879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:00.528299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 185/377] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:59:00 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:00.617235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dc917-a21d-4a87-8b34-5d22d0b8d907 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:00.676111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:00.676908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:00.677196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:00.677473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] PATH_INFO: `/v3/projects/d99a6eb193bd41428c297fd4b90b9d66` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:00.683796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=d99a6eb193bd41428c297fd4b90b9d66)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:00.685340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:00.687664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 193/378] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:00 2022] GET /identity/v3/projects/d99a6eb193bd41428c297fd4b90b9d66 => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:00.693122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:00.751264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:00.842553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eb3c5-44df-49bc-88d2-5e8cc660391a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:00.879011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d798f-3250-41ed-9362-05f8005db96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:00.879940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d798f-3250-41ed-9362-05f8005db96e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:00.880225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d798f-3250-41ed-9362-05f8005db96e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:00.880498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d798f-3250-41ed-9362-05f8005db96e None admin] PATH_INFO: `/v3/groups/e8a7f4f0c5764812b44cd22295a91e97` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:00.887323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d798f-3250-41ed-9362-05f8005db96e None admin] RBAC: Authorizing `identity:get_group(group_id=e8a7f4f0c5764812b44cd22295a91e97)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:00.888836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d798f-3250-41ed-9362-05f8005db96e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:00.890830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 186/379] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:00 2022] GET /identity/v3/groups/e8a7f4f0c5764812b44cd22295a91e97 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:00.899933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:00.957635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:01.030608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c9dc6-e238-4b8e-9799-77375745d5a1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:01.076081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edeae6-1f37-4622-aa0b-51f8f6941258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:01.076739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edeae6-1f37-4622-aa0b-51f8f6941258 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:01.077020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edeae6-1f37-4622-aa0b-51f8f6941258 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:01.077292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edeae6-1f37-4622-aa0b-51f8f6941258 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:01.078120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edeae6-1f37-4622-aa0b-51f8f6941258 None admin] RBAC: Adding query filter params (group.id=e8a7f4f0c5764812b44cd22295a91e97, role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=d99a6eb193bd41428c297fd4b90b9d66) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:01.078428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edeae6-1f37-4622-aa0b-51f8f6941258 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:01.079879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edeae6-1f37-4622-aa0b-51f8f6941258 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:01.086597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 194/380] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:59:00 2022] GET /identity/v3/role_assignments?group.id=e8a7f4f0c5764812b44cd22295a91e97&scope.project.id=d99a6eb193bd41428c297fd4b90b9d66&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:01.641585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179e74-106d-4f15-ba5a-17e32254def9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:01.642025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179e74-106d-4f15-ba5a-17e32254def9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:01.642121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d179e74-106d-4f15-ba5a-17e32254def9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:01.643793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 187/381] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:01.656406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8d7-bb59-4af2-9abd-e276d4649b5a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:01.657277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8d7-bb59-4af2-9abd-e276d4649b5a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:01.657730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4b8d7-bb59-4af2-9abd-e276d4649b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:01.684544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e7d4b8d7-bb59-4af2-9abd-e276d4649b5a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:01.686087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e7d4b8d7-bb59-4af2-9abd-e276d4649b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:01.772174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 195/382] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:01.814990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d179e74-106d-4f15-ba5a-17e32254def9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:01.934770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d179e74-106d-4f15-ba5a-17e32254def9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:01.937661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:01.976913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836208b0-9131-4542-9cd4-19537640659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:01.977772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836208b0-9131-4542-9cd4-19537640659c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:01.978054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836208b0-9131-4542-9cd4-19537640659c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:01.978328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836208b0-9131-4542-9cd4-19537640659c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:01.992800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836208b0-9131-4542-9cd4-19537640659c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-836208b0-9131-4542-9cd4-19537640659c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:02.000800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:02.001674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:02.002472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 188/383] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:02.008732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b8d7-bb59-4af2-9abd-e276d4649b5a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:02.043894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:02.109869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4b8d7-bb59-4af2-9abd-e276d4649b5a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:02.144544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a8f9d-062b-4c05-989f-50a15e48b2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:02.145212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8f9d-062b-4c05-989f-50a15e48b2bc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.145487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8f9d-062b-4c05-989f-50a15e48b2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.145759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a8f9d-062b-4c05-989f-50a15e48b2bc None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.146531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8f9d-062b-4c05-989f-50a15e48b2bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:02.146806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8f9d-062b-4c05-989f-50a15e48b2bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:02.148225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a8f9d-062b-4c05-989f-50a15e48b2bc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:02.161162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 196/384] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:02.162470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836208b0-9131-4542-9cd4-19537640659c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:02.269280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb18af-cf97-4078-8ea4-0244437794a8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.269573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb18af-cf97-4078-8ea4-0244437794a8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.269752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb18af-cf97-4078-8ea4-0244437794a8 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.271500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 197/385] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:02.282951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc1779-1140-449d-b026-e68e1e2e55b2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.283238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc1779-1140-449d-b026-e68e1e2e55b2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.283509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc1779-1140-449d-b026-e68e1e2e55b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.303528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836208b0-9131-4542-9cd4-19537640659c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:02.303820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-38fc1779-1140-449d-b026-e68e1e2e55b2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:02.305538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-38fc1779-1140-449d-b026-e68e1e2e55b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:02.393223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:02.397760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.398124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.398407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.400445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:02.402303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:02.404646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 189/386] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:02 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:02.409813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:02.433353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 198/387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:02.455334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:02.467273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc1779-1140-449d-b026-e68e1e2e55b2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:02.511215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:02.600867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c009a7e7-882d-4699-8da0-4ce0157cf50f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:02.604601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc1779-1140-449d-b026-e68e1e2e55b2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:02.645166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eea82d-fe07-4ade-8d0e-6d10aff8e864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:02.647190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea82d-fe07-4ade-8d0e-6d10aff8e864 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.647618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea82d-fe07-4ade-8d0e-6d10aff8e864 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.648145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eea82d-fe07-4ade-8d0e-6d10aff8e864 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.649583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eea82d-fe07-4ade-8d0e-6d10aff8e864 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:02.650851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3196c57d-d9a0-4eae-8018-df99d8120a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:02.651471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eea82d-fe07-4ade-8d0e-6d10aff8e864 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:02.651840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c57d-d9a0-4eae-8018-df99d8120a66 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.652219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c57d-d9a0-4eae-8018-df99d8120a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.652604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3196c57d-d9a0-4eae-8018-df99d8120a66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.654290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 190/388] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:02 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:02.656321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59da545-c0a8-4834-ab4b-c6cef3e7b10a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.656749 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59da545-c0a8-4834-ab4b-c6cef3e7b10a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.657169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59da545-c0a8-4834-ab4b-c6cef3e7b10a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.664167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 191/389] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:02.664329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59da545-c0a8-4834-ab4b-c6cef3e7b10a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:02.668508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3196c57d-d9a0-4eae-8018-df99d8120a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-3196c57d-d9a0-4eae-8018-df99d8120a66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:02.676780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:02.677650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:02.678505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 199/390] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:02.683461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618b6a-1376-4980-84a9-1f949e04358e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.683954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618b6a-1376-4980-84a9-1f949e04358e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.684074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc618b6a-1376-4980-84a9-1f949e04358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.702095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fc618b6a-1376-4980-84a9-1f949e04358e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:02.703310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fc618b6a-1376-4980-84a9-1f949e04358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:02.782863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 200/391] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:02.782863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc618b6a-1376-4980-84a9-1f949e04358e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:02.797602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:02.799229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:02.809574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59da545-c0a8-4834-ab4b-c6cef3e7b10a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:02.850519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:02.852411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.852893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.853379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e/groups/5fb68e33929d49f9a449910e579880bf/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.855624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc54ff0c5398464b9c085152fd7db90e, group_id=5fb68e33929d49f9a449910e579880bf, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:02.857257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:02.886922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 192/392] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 19:59:02 2022] PUT /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e/groups/5fb68e33929d49f9a449910e579880bf/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:02.889875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:02.897517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc618b6a-1376-4980-84a9-1f949e04358e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:02.996706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:02.997644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:02.998077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:02.998528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:02.999460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:02.999916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:03.001461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:03.038935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 201/393] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:03.040198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.063547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9cdf7-0aa4-4487-b812-d4aac5b9dd28 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:03.129287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:03.130098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.130383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.130796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.166930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:03.184018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:03.185343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:03.186184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:03.188465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 193/394] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:03.194491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.210877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:03.225245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:03.231503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e66328-c0b7-4f68-aca7-48e91f4e0fbe None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:03.274098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:03.275237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.276546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.276970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.281760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:03.283432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:03.285548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 202/395] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:03 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:03.291081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.316474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76bae-72bd-4d88-8d71-59e761a66e47 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:03.355140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:03.356160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.356577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.357097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.357989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:03.358503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:03.360137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:03.369535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 194/396] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:03.375984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.427077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92aec0f-16be-4e87-ace8-011e35e37a36 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:03.482347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:03.483598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.484047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.484655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.486245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:03.488036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:03.490428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 203/397] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:03 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:03.502976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.529901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:03.596036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:03.619389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2daf95e-650f-43a7-bcaa-2d2d5ea2697e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:03.660481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ee6c2-81e3-42bb-98b0-f3d1d09dd6fb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:03.665406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716132-b0d3-44ef-88fa-fde417c9f31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:03.666501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716132-b0d3-44ef-88fa-fde417c9f31f None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.667033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716132-b0d3-44ef-88fa-fde417c9f31f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.667459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716132-b0d3-44ef-88fa-fde417c9f31f None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/groups/5fb68e33929d49f9a449910e579880bf/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.669595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716132-b0d3-44ef-88fa-fde417c9f31f None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb2ebcfc1134898824164d20ac1f3a2, group_id=5fb68e33929d49f9a449910e579880bf, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:03.671896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716132-b0d3-44ef-88fa-fde417c9f31f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:03.687852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 204/398] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 19:59:03 2022] PUT /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/groups/5fb68e33929d49f9a449910e579880bf/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:59:03.689705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b40d-efa6-427f-bded-1fcfdf7e7014 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.690197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b40d-efa6-427f-bded-1fcfdf7e7014 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.690705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2b40d-efa6-427f-bded-1fcfdf7e7014 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.698483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 205/399] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:03.710218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf173-29b1-442b-8247-07077affbea8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.711147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf173-29b1-442b-8247-07077affbea8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.711415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf173-29b1-442b-8247-07077affbea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.723980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:03.725405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.725701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.725981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.730190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:03.731697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:03.735095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 195/400] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:03 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:03.739385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-27ccf173-29b1-442b-8247-07077affbea8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:03.740656 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-27ccf173-29b1-442b-8247-07077affbea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:03.742002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.832575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 206/401] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:59:03.834135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751a7b7-b740-4a73-86ba-18f62f77f989 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.834432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751a7b7-b740-4a73-86ba-18f62f77f989 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.834711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751a7b7-b740-4a73-86ba-18f62f77f989 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.836748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 207/402] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:03.842341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0560-1368-4e1a-b31b-3d439c00a40c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.842638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0560-1368-4e1a-b31b-3d439c00a40c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.842939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db0560-1368-4e1a-b31b-3d439c00a40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.855496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:03.862081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e9db0560-1368-4e1a-b31b-3d439c00a40c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:03.864309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e9db0560-1368-4e1a-b31b-3d439c00a40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:03.881763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6065c-3368-4fa0-a855-00e1686843d4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:03.933688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:03.934525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:03.934820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:03.935128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:03.936346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:03.937796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:03.939805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 196/403] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:03 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:03.940364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.952397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 208/404] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:59:03.953470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0560-1368-4e1a-b31b-3d439c00a40c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:03.978756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:04.068115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db0560-1368-4e1a-b31b-3d439c00a40c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:04.086373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fba8c-9814-4fdc-9ba3-5442c7169f15 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:04.109549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:04.110440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:04.110723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:04.111104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e/groups/5fb68e33929d49f9a449910e579880bf/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:04.113491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc54ff0c5398464b9c085152fd7db90e, group_id=5fb68e33929d49f9a449910e579880bf, role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:04.115639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:04.119602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:04.124291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:04.125434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:04.125935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:04.126456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:04.139539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 209/405] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 19:59:03 2022] PUT /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e/groups/5fb68e33929d49f9a449910e579880bf/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:04.145412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:04.152939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:04.170873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:04.171839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:04.172614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:04.175500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 197/406] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:04.181052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:04.281130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923e078-18d4-4108-995b-ec2a1b321d59 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:04.324262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:04.327228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:04.327513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:04.327782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:04.359597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:04.375950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:04.376907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:04.377700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 210/407] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:04.383152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:04.385501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:04.416439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd9f9-60c6-4586-a160-c884656b5e74 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:04.465114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:04.466739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:04.467402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:04.468016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:04.468559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:04.469662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:04.470506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:04.473330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:04.489891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 198/408] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:04.493372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:04.538924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00262-8d75-4c51-a6ff-b9b1a2bfcb67 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:04.587514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:04.595389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:04.595955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:04.597621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:04.599413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:04.600146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:04.604275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:04.634147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 211/409] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:04.636650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:04.714806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21d836-2c8c-4b12-aef4-aef50aeb1e6e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:04.789727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:04.790510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:04.790799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:04.791124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:04.791475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900fb05-57e8-4061-a325-dc028907a3e9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:04.792319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:04.793756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:04.795988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 199/410] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:04 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:04.810456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:04.815605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:04.830821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:04.835001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:04.836179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:04.836527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:04.836912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] PATH_INFO: `/v3/groups/e8a7f4f0c5764812b44cd22295a91e97` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:04.838234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] RBAC: Authorizing `identity:get_group(group_id=e8a7f4f0c5764812b44cd22295a91e97)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:04.842860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:04.847567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 212/411] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:04 2022] GET /identity/v3/groups/e8a7f4f0c5764812b44cd22295a91e97 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:04.848771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:04.987181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d806ea-c8e6-45d8-80f5-11dda6715d34 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:05.044920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e38df-b912-4077-a534-3e3625909ad9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:05.082920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:05.083801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:05.084088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:05.084373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:05.086542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:05.088017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:05.091473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 200/412] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:04 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:05.092643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:05.093518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:05.093803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:05.094081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] PATH_INFO: `/v3/projects/d99a6eb193bd41428c297fd4b90b9d66` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:05.095566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] RBAC: Authorizing `identity:get_project(project_id=d99a6eb193bd41428c297fd4b90b9d66)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:05.097028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:05.099472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:05.100440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 213/413] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:04 2022] GET /identity/v3/projects/d99a6eb193bd41428c297fd4b90b9d66 => generated 344 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:05.105684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:05.223365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:05.233813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:05.251323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04484ecd-a713-4881-b1b2-898cfd651b4b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:05.291021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e094beb5-3156-4ded-854a-67c9052dc74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:05.291922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094beb5-3156-4ded-854a-67c9052dc74f None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:05.292216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094beb5-3156-4ded-854a-67c9052dc74f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:05.292502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e094beb5-3156-4ded-854a-67c9052dc74f None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/groups/5fb68e33929d49f9a449910e579880bf/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:05.294912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094beb5-3156-4ded-854a-67c9052dc74f None admin] RBAC: Authorizing `identity:create_grant(project_id=bcb2ebcfc1134898824164d20ac1f3a2, group_id=5fb68e33929d49f9a449910e579880bf, role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:05.296435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e094beb5-3156-4ded-854a-67c9052dc74f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:05.316977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 201/414] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 19:59:05 2022] PUT /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2/groups/5fb68e33929d49f9a449910e579880bf/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:05.342136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3803fb-5f5b-4aa6-9a09-e8cb78a3c5bc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:05.393530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5814315-dc68-4b99-9290-ae87ce34c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:05.394432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5814315-dc68-4b99-9290-ae87ce34c617 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:05.394776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5814315-dc68-4b99-9290-ae87ce34c617 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:05.395117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5814315-dc68-4b99-9290-ae87ce34c617 None admin] PATH_INFO: `/v3/projects/d99a6eb193bd41428c297fd4b90b9d66/groups/e8a7f4f0c5764812b44cd22295a91e97/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:05.397133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5814315-dc68-4b99-9290-ae87ce34c617 None admin] RBAC: Authorizing `identity:create_grant(project_id=d99a6eb193bd41428c297fd4b90b9d66, group_id=e8a7f4f0c5764812b44cd22295a91e97, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:05.399213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5814315-dc68-4b99-9290-ae87ce34c617 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:05.415572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 214/415] 10.222.0.48 () {58 vars in 1442 bytes} [Thu May 26 19:59:05 2022] PUT /identity/v3/projects/d99a6eb193bd41428c297fd4b90b9d66/groups/e8a7f4f0c5764812b44cd22295a91e97/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:05.812445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b4ae5-3fab-4e3f-9b0e-3a97b33d1241 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:05.812948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b4ae5-3fab-4e3f-9b0e-3a97b33d1241 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:05.813023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b4ae5-3fab-4e3f-9b0e-3a97b33d1241 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:05.814662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 202/416] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:05.820658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2820-1e19-4abf-8a11-ab4d54e636d3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:05.821093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2820-1e19-4abf-8a11-ab4d54e636d3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:05.821187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2820-1e19-4abf-8a11-ab4d54e636d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:05.838682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b4df2820-1e19-4abf-8a11-ab4d54e636d3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:05.839902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b4df2820-1e19-4abf-8a11-ab4d54e636d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:05.933277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 215/417] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:05.980344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b4ae5-3fab-4e3f-9b0e-3a97b33d1241 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:06.117057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b4ae5-3fab-4e3f-9b0e-3a97b33d1241 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:06.171567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6276eb8-eea7-4432-bb8b-d47e3f7f5c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:06.172385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276eb8-eea7-4432-bb8b-d47e3f7f5c1e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.172676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276eb8-eea7-4432-bb8b-d47e3f7f5c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.172958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6276eb8-eea7-4432-bb8b-d47e3f7f5c1e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.176016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:06.196597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6276eb8-eea7-4432-bb8b-d47e3f7f5c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f6276eb8-eea7-4432-bb8b-d47e3f7f5c1e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:06.204591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:06.205491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:06.206284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 203/418] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:06.214422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df2820-1e19-4abf-8a11-ab4d54e636d3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:06.311329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:06.337856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d497f2-7697-40e4-9846-3dabc4cf8fbb None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.338574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d497f2-7697-40e4-9846-3dabc4cf8fbb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.339058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d497f2-7697-40e4-9846-3dabc4cf8fbb None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.343521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 204/419] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:06.348040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304416-7758-4a2a-80fe-857c3b3b5f7f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.348706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304416-7758-4a2a-80fe-857c3b3b5f7f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.349172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304416-7758-4a2a-80fe-857c3b3b5f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.368778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df2820-1e19-4abf-8a11-ab4d54e636d3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:06.385884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-92304416-7758-4a2a-80fe-857c3b3b5f7f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:06.387125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-92304416-7758-4a2a-80fe-857c3b3b5f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:06.412054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:06.413109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.413634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.414111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.415949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:06.416464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:06.420094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:06.439956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 216/420] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:59:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:06.442425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:06.502573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 205/421] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:59:06.538394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304416-7758-4a2a-80fe-857c3b3b5f7f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:06.609816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f866-9834-45b1-a2bc-a025b679e9fe None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:06.624125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:06.660469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d804b-e42f-4355-8bda-d44c4d70091e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:06.662045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d804b-e42f-4355-8bda-d44c4d70091e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.662538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d804b-e42f-4355-8bda-d44c4d70091e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.663068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d804b-e42f-4355-8bda-d44c4d70091e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.738023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d804b-e42f-4355-8bda-d44c4d70091e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:06.740131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d804b-e42f-4355-8bda-d44c4d70091e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:06.845603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304416-7758-4a2a-80fe-857c3b3b5f7f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:06.854602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 217/422] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:06.856544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e24e-4640-4ef6-b084-a9308076cb19 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.857042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e24e-4640-4ef6-b084-a9308076cb19 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.857520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd0e24e-4640-4ef6-b084-a9308076cb19 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.859301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 218/423] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:06.862398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0e24e-4640-4ef6-b084-a9308076cb19 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:06.879213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:06.884608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:06.900236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4ce04-deea-46bf-b4b3-ac818ced8ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:06.901426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4ce04-deea-46bf-b4b3-ac818ced8ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.901895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4ce04-deea-46bf-b4b3-ac818ced8ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.902357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4ce04-deea-46bf-b4b3-ac818ced8ce5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.914516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4ce04-deea-46bf-b4b3-ac818ced8ce5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f3d4ce04-deea-46bf-b4b3-ac818ced8ce5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:06.922649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:06.923754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:59:06.924752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:06.927308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 206/424] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:06.928860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719718a-4b19-464f-bfc1-39f09aa98b5f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:06.929921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719718a-4b19-464f-bfc1-39f09aa98b5f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:06.930395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719718a-4b19-464f-bfc1-39f09aa98b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:06.948375 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4719718a-4b19-464f-bfc1-39f09aa98b5f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:06.949904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4719718a-4b19-464f-bfc1-39f09aa98b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:07.003134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd0e24e-4640-4ef6-b084-a9308076cb19 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.021129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 207/425] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:07.028011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719718a-4b19-464f-bfc1-39f09aa98b5f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.048425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.050980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.051285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.051568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.056105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:07.058930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:07.061209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 219/426] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:06 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:07.062293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.152866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719718a-4b19-464f-bfc1-39f09aa98b5f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.174182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:07.175311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:07.186107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c31b5-4cf7-41cd-bab8-a5c60333563e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.198482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.199331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.199718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.200119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.201440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] RBAC: Adding query filter params (name=member) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:07.201756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:07.203316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:07.218994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 208/427] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:07.221563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.237068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.238157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.238635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.239298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.251272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:07.260286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:07.261189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:07.261953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:07.269144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 220/428] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:07.270253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.329744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6693c-7c48-4cb5-964e-da29c38a811f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.369421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.370532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.370999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.371451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.372816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:07.374438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:07.376286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 209/429] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:07.377209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.386444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc55a6-e749-4c37-a2b6-24b5ca8b56ad None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.430927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.431886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.432805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.433265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.437267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:07.441531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:07.514308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:07.515954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:07.524350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244ac05-77c4-41ee-afdc-2276af327e26 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.562461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.563568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.564035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.564491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.565447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:07.566490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:07.568598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:07.581455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 210/430] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:07.582535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.649400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 221/431] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:07.650398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.688825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:07.727767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec6032-1716-4f6e-a2f1-dcf03e6d0193 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.739095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:07.767866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.768789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.769176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.769625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.770483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=cc54ff0c5398464b9c085152fd7db90e) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:07.770938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:07.772173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01848ad6-6f38-4585-b381-1cdb3b242c6b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.772783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:07.787053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 211/432] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=2f1a975d114c4307b75105be01055d98 => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:07.788253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:07.824512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfd4c4-c0d6-4c1e-b3a9-a0ff1c2e12aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:07.825777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd4c4-c0d6-4c1e-b3a9-a0ff1c2e12aa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:07.825959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd4c4-c0d6-4c1e-b3a9-a0ff1c2e12aa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:07.827776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfd4c4-c0d6-4c1e-b3a9-a0ff1c2e12aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:07.927977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfd4c4-c0d6-4c1e-b3a9-a0ff1c2e12aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:07.930082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bfd4c4-c0d6-4c1e-b3a9-a0ff1c2e12aa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:07.954374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247fdbf9-6dd7-49f5-8821-9896bd023f95 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:07.967648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.008347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc74c5-8437-43c6-a7d2-8f9cccedc078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.009216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc74c5-8437-43c6-a7d2-8f9cccedc078 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.009732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc74c5-8437-43c6-a7d2-8f9cccedc078 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.010196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc74c5-8437-43c6-a7d2-8f9cccedc078 None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.011505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc74c5-8437-43c6-a7d2-8f9cccedc078 None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.012854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc74c5-8437-43c6-a7d2-8f9cccedc078 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.014669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 212/433] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.016125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d326a5-13c1-48b6-b1db-7a07dcf862c7 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.016555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d326a5-13c1-48b6-b1db-7a07dcf862c7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.017069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d326a5-13c1-48b6-b1db-7a07dcf862c7 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.018463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 213/434] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:08.019994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8568b-ddfd-49e5-8f60-6b0fd2ce4274 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.020425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8568b-ddfd-49e5-8f60-6b0fd2ce4274 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.021035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8568b-ddfd-49e5-8f60-6b0fd2ce4274 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.022519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 214/435] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:08.023872 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8568b-ddfd-49e5-8f60-6b0fd2ce4274 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.056310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 222/436] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:08.057427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14112-d5ee-46a2-a657-55ee562e8c3d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.057716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14112-d5ee-46a2-a657-55ee562e8c3d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.057990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b14112-d5ee-46a2-a657-55ee562e8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.074996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a0b14112-d5ee-46a2-a657-55ee562e8c3d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:08.076147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.076282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a0b14112-d5ee-46a2-a657-55ee562e8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:08.152004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8568b-ddfd-49e5-8f60-6b0fd2ce4274 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.156910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 223/437] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:08.158187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef8e0-c989-4a49-a175-395157bf4240 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.158307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef8e0-c989-4a49-a175-395157bf4240 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.160732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565ef8e0-c989-4a49-a175-395157bf4240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.182689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-565ef8e0-c989-4a49-a175-395157bf4240 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:08.184372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-565ef8e0-c989-4a49-a175-395157bf4240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:08.193410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.194307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.194591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.195184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.197659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.197859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.199778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 215/438] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.200556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.254029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.262338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 224/439] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:08.263310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef8e0-c989-4a49-a175-395157bf4240 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.307236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5dbbd-6f3d-4aea-90a8-7d263e40f781 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.315978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.341738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.342608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.342914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.343190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] PATH_INFO: `/v3/projects/cc54ff0c5398464b9c085152fd7db90e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.344367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] RBAC: Authorizing `identity:get_project(project_id=cc54ff0c5398464b9c085152fd7db90e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.345777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.347498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 216/440] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/projects/cc54ff0c5398464b9c085152fd7db90e => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.348246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.366094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565ef8e0-c989-4a49-a175-395157bf4240 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.399845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.400651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.400936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.401209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.411049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:08.419197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:08.420051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:08.420837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 225/441] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:08.421509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.450521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4ccee-4293-4f03-a5a7-70841e4a7148 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.476926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.484141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.484800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.485083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.485359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.486181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=2f1a975d114c4307b75105be01055d98, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:08.486489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.487932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.493771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 217/442] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=2f1a975d114c4307b75105be01055d98 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.494530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.533657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0c2a-2b83-4301-ba74-88c9b5ffcc09 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.543087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.574893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.575728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.576232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.576513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.589501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:08.597634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:08.598606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:08.599443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 226/443] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:08.600094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.614178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8c0745-77de-44e6-99a4-6df505bc4a7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.661201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.662082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.662365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.662644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.663924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.665395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.667081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 218/444] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.667844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.727347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ab75e-67bb-41c0-bc05-f9a3a0637010 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.741092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.762092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.762755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.763079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.763357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.764096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:08.764399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.765777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.773590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 227/445] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.774354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.778459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d21e2-dc13-4395-8481-b6a3b5991cda None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.787358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:08.812463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.813136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.813431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.813711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.814459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:08.814765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.816165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.824846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 219/446] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.825622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.871694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9020d-a33d-430b-8ce7-fb2455e9d592 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.903559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.904196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.904473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.904744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.905561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=cc54ff0c5398464b9c085152fd7db90e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:08.905865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:08.907325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:08.912842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 228/447] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=cc54ff0c5398464b9c085152fd7db90e&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:08.913649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:08.923742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3c5be-6a73-4e6a-af6a-e58ac452bd7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:08.960935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:08.961630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:08.961867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:08.962140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:08.963767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:09.005803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:09.032795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cbdd2b-06ca-42d1-8644-26d0f06777db None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:09.038287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.039844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.070415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:09.071121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:09.071411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:09.071691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:09.151518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 220/448] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:09.154649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.156160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.157150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:09.205373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:09.243778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:09.280234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 229/449] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:09.280606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ba28d-7ce1-4e9e-83ab-f322a33a33ca None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:09.285629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:09.323483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:09.326290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:09.327244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:09.327244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] PATH_INFO: `/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:09.329495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] RBAC: Authorizing `identity:get_project(project_id=bcb2ebcfc1134898824164d20ac1f3a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.331969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.332711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 221/450] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:09 2022] GET /identity/v3/projects/bcb2ebcfc1134898824164d20ac1f3a2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:09.338102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:09.399807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4122e85-4ae3-4885-93e6-c924e9a3312f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:09.438078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:09.438967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:09.439250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:09.439522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] PATH_INFO: `/v3/projects/d99a6eb193bd41428c297fd4b90b9d66` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:09.440703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] RBAC: Authorizing `identity:get_project(project_id=d99a6eb193bd41428c297fd4b90b9d66)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.442140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.444214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 230/451] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 19:59:09 2022] GET /identity/v3/projects/d99a6eb193bd41428c297fd4b90b9d66 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:09.449481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:09.459878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716cef54-4396-48ce-8aaf-790f2ee8601c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:09.461799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:09.496812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:09.497675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:09.497957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:09.498231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] PATH_INFO: `/v3/groups/5fb68e33929d49f9a449910e579880bf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:09.499425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] RBAC: Authorizing `identity:get_group(group_id=5fb68e33929d49f9a449910e579880bf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.500860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.502630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 222/452] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:09 2022] GET /identity/v3/groups/5fb68e33929d49f9a449910e579880bf => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:09.508107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:09.517200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:09.551354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29885848-8929-4eba-ae32-eff94f01e5c0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:09.583728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:09.584521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:09.584800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:09.585072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] PATH_INFO: `/v3/groups/e8a7f4f0c5764812b44cd22295a91e97` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:09.586771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] RBAC: Authorizing `identity:get_group(group_id=e8a7f4f0c5764812b44cd22295a91e97)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.588232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.589840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 231/453] 10.222.0.48 () {56 vars in 1180 bytes} [Thu May 26 19:59:09 2022] GET /identity/v3/groups/e8a7f4f0c5764812b44cd22295a91e97 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:09.595516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:09.608361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24655188-4199-4dd4-96bd-50eba646d097 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:09.646638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612a9e4-c4b5-463b-b050-f72206d79937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:09.647331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612a9e4-c4b5-463b-b050-f72206d79937 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:09.647619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612a9e4-c4b5-463b-b050-f72206d79937 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:09.648731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612a9e4-c4b5-463b-b050-f72206d79937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:09.649242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612a9e4-c4b5-463b-b050-f72206d79937 None admin] RBAC: Adding query filter params (group.id=5fb68e33929d49f9a449910e579880bf, role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:09.649555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612a9e4-c4b5-463b-b050-f72206d79937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.651021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612a9e4-c4b5-463b-b050-f72206d79937 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.656746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 223/454] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:59:09 2022] GET /identity/v3/role_assignments?group.id=5fb68e33929d49f9a449910e579880bf&scope.project.id=bcb2ebcfc1134898824164d20ac1f3a2&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:09.673169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:09.698387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617ad63-5523-4e4f-84de-51581399b6e8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:09.734712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4d679-cf1b-4641-8365-cd61b7124d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:09.735437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4d679-cf1b-4641-8365-cd61b7124d67 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:09.735721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4d679-cf1b-4641-8365-cd61b7124d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:09.735994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4d679-cf1b-4641-8365-cd61b7124d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:09.736842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4d679-cf1b-4641-8365-cd61b7124d67 None admin] RBAC: Adding query filter params (group.id=e8a7f4f0c5764812b44cd22295a91e97, role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=d99a6eb193bd41428c297fd4b90b9d66) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:09.737153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4d679-cf1b-4641-8365-cd61b7124d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:09.738623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4d679-cf1b-4641-8365-cd61b7124d67 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:09.745325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 232/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu May 26 19:59:09 2022] GET /identity/v3/role_assignments?group.id=e8a7f4f0c5764812b44cd22295a91e97&scope.project.id=d99a6eb193bd41428c297fd4b90b9d66&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:12.367967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828f636-4c05-41bc-a770-020293cd016f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:12.368996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828f636-4c05-41bc-a770-020293cd016f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:12.369515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828f636-4c05-41bc-a770-020293cd016f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:12.371411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 224/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:12.376642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f1790-3656-433e-ad42-170d96d269f3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:12.377457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f1790-3656-433e-ad42-170d96d269f3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:12.377919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f1790-3656-433e-ad42-170d96d269f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:12.400172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dc7f1790-3656-433e-ad42-170d96d269f3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:12.401644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dc7f1790-3656-433e-ad42-170d96d269f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:12.501164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 233/457] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:12.545103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828f636-4c05-41bc-a770-020293cd016f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:12.620653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:12.655459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828f636-4c05-41bc-a770-020293cd016f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:12.690491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeac1d-746a-438f-a122-1152a4deea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:12.691332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeac1d-746a-438f-a122-1152a4deea72 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:12.691618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeac1d-746a-438f-a122-1152a4deea72 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:12.691896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeac1d-746a-438f-a122-1152a4deea72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:12.712776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeac1d-746a-438f-a122-1152a4deea72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:12.714262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeac1d-746a-438f-a122-1152a4deea72 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9ddeac1d-746a-438f-a122-1152a4deea72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:12.734553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:12.735505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:12.736320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:12.736320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:12.736320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:12.736320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:12.736320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 225/458] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:12.741819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f1790-3656-433e-ad42-170d96d269f3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:12.829010 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba37c1-6710-4330-a23f-a78d33773132 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:12.829674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba37c1-6710-4330-a23f-a78d33773132 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:12.830019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba37c1-6710-4330-a23f-a78d33773132 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:12.831760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 226/459] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:59:12.838165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc3f7-d8ae-4921-848f-88123af0a84d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:12.838567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc3f7-d8ae-4921-848f-88123af0a84d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:12.838951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cc3f7-d8ae-4921-848f-88123af0a84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:12.849095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:12.870527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d89cc3f7-d8ae-4921-848f-88123af0a84d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:12.871814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d89cc3f7-d8ae-4921-848f-88123af0a84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:12.907869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f1790-3656-433e-ad42-170d96d269f3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:12.982265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1481a3-f19e-4034-bc09-714d24949141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:12.982965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1481a3-f19e-4034-bc09-714d24949141 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:12.983248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1481a3-f19e-4034-bc09-714d24949141 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:12.983516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1481a3-f19e-4034-bc09-714d24949141 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:12.984244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1481a3-f19e-4034-bc09-714d24949141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:12.984546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1481a3-f19e-4034-bc09-714d24949141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:12.985929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1481a3-f19e-4034-bc09-714d24949141 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.001543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 227/460] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:13.002990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505052c1-eab3-4178-b5e1-fed75fc87c8a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.003411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505052c1-eab3-4178-b5e1-fed75fc87c8a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.003693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505052c1-eab3-4178-b5e1-fed75fc87c8a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.009863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 228/462] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:13.010153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 234/462] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:13.015580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505052c1-eab3-4178-b5e1-fed75fc87c8a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.016159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f94ed4-779f-484e-a0a5-08f9184486d1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.016453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f94ed4-779f-484e-a0a5-08f9184486d1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.016738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f94ed4-779f-484e-a0a5-08f9184486d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.043309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-69f94ed4-779f-484e-a0a5-08f9184486d1 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:13.044517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-69f94ed4-779f-484e-a0a5-08f9184486d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:13.083944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:13.117775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 235/463] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:59:13.118632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f94ed4-779f-484e-a0a5-08f9184486d1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.151252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505052c1-eab3-4178-b5e1-fed75fc87c8a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:13.178232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:13.197956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:13.198737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.199052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.199327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.200145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:13.201679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.228417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 229/464] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:59:13 2022] POST /identity/v3/users => generated 246 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:13.229252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.238997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f94ed4-779f-484e-a0a5-08f9184486d1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:13.288509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d28718-b21d-438a-a8e0-e6064b39f5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:13.289374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28718-b21d-438a-a8e0-e6064b39f5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.289655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28718-b21d-438a-a8e0-e6064b39f5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.289927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28718-b21d-438a-a8e0-e6064b39f5b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.302213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d28718-b21d-438a-a8e0-e6064b39f5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:13.303764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d28718-b21d-438a-a8e0-e6064b39f5b3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d8d28718-b21d-438a-a8e0-e6064b39f5b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:13.327330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:13.329403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 236/465] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac805ae-75d9-46d8-8524-0398e423106e None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac805ae-75d9-46d8-8524-0398e423106e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.331491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac805ae-75d9-46d8-8524-0398e423106e None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.334950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 237/466] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:13.338502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b0e3-c82b-4ba2-a40e-d1cc21ffc0f4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.339036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b0e3-c82b-4ba2-a40e-d1cc21ffc0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.339418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b0e3-c82b-4ba2-a40e-d1cc21ffc0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.358238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9b15b0e3-c82b-4ba2-a40e-d1cc21ffc0f4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:13.359733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9b15b0e3-c82b-4ba2-a40e-d1cc21ffc0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:13.362579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22323b-ec6a-43c1-8f7e-0fcb31c05c3b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:13.376370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:13.413875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:13.415128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.415428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.416440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.436097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:13.437679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.449350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 238/467] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:13.450757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b0e3-c82b-4ba2-a40e-d1cc21ffc0f4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:13.457444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:13.458293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:13.459169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:13.459169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:13.459169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:13.459169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:13.459169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 230/468] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:13.466343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.507865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:13.576549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b0e3-c82b-4ba2-a40e-d1cc21ffc0f4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:13.589709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2183a-c92e-4f17-aca0-b72ffaafc96e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:13.613212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:13.614175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.614662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.615155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.616056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:13.617075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:13.618628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.625268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:13.626027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.626314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.626585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.627342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:13.627646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:13.629077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.633696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 239/469] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:13.634761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.652807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 231/470] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:13.653774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.676854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:13.742992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ebb4aa-4be3-4442-a91b-870cb8a0d499 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:13.744834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:13.760065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeb4c5-e254-4c80-a06c-9c98965d64f5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:13.781981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:13.783239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.783732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.784209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.798182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:13.799770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:13.800458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:13.800702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.800803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:13.801014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:13.801717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:13.803216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:13.821590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:13.822473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:13.823366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:13.823366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:13.823366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:13.823366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:13.830617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 240/472] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:13.831919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.835172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 232/472] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:59:13 2022] POST /identity/v3/users => generated 248 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:59:13.837336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:13.979475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:13.983334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ededf-9a84-4052-8201-3b879f5d6771 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:14.005954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a766-2f57-4ff3-aceb-fc1558ae0c9d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:14.023534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450264ed-8be2-4fbb-b458-6bbea20ab2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:14.024609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450264ed-8be2-4fbb-b458-6bbea20ab2b8 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.025091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450264ed-8be2-4fbb-b458-6bbea20ab2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.025592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450264ed-8be2-4fbb-b458-6bbea20ab2b8 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.026511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450264ed-8be2-4fbb-b458-6bbea20ab2b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:14.028219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450264ed-8be2-4fbb-b458-6bbea20ab2b8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:14.045914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:14.046705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.047040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.047302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.048038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:14.048380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:14.049725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:14.056141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 241/473] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:59:13 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:14.058461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e4a4d-bf50-4a1e-9540-17fd4661e149 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.058760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e4a4d-bf50-4a1e-9540-17fd4661e149 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.059077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e4a4d-bf50-4a1e-9540-17fd4661e149 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.060752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 242/474] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:14.065464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 233/475] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:14.070128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e452c5-70bb-4dc8-a4dd-1f8c8c40532a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.070128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e452c5-70bb-4dc8-a4dd-1f8c8c40532a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.070128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e452c5-70bb-4dc8-a4dd-1f8c8c40532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.072581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:14.092988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a4e452c5-70bb-4dc8-a4dd-1f8c8c40532a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:14.094367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a4e452c5-70bb-4dc8-a4dd-1f8c8c40532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:14.108273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:14.183040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 243/476] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:14.189005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e6454-1cfd-44f2-a672-9f51bd40bd9c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:14.203993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e452c5-70bb-4dc8-a4dd-1f8c8c40532a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:14.230703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:14.231789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.232277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.232749 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.233726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:14.235507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:14.244417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:14.262899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 234/477] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:59:14 2022] POST /identity/v3/users => generated 249 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:59:14.328467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e452c5-70bb-4dc8-a4dd-1f8c8c40532a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:14.368205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:14.369247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.369670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.370082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.371016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:14.372579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:14.385880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.sql.core [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 19:59:14.385880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 19:59:14.385880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [parameters: {'id': '80ad564a3a30429eb5fe300464988aee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 19:59:14.385880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80413) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application conn.query(q) May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application result.read() May 26 19:59:14.404654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return ref.to_dict() May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:59:14.405578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application next(self.gen) May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application yield resource May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application next(self.gen) May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self.session.rollback() May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self.force_reraise() May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise self.value May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application session.commit() May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 19:59:14.406971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._prepare_impl() May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self.session.flush() May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._flush(objects) May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application compat.raise_( May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application flush_context.execute() May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rec.execute(self) May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 19:59:14.407816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:59:14.408668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application conn.query(q) May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application result.read() May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:59:14.409456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [parameters: {'id': '80ad564a3a30429eb5fe300464988aee', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:14.410230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 19:59:14.411084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:14.414150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 244/478] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 19:59:14 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:14.418436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:14.530750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2a101-a808-4510-9425-a5cdf0c52eba None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:14.566464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b26b1-2360-4ed2-b147-9db77c41041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:14.567322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b26b1-2360-4ed2-b147-9db77c41041d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.567607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b26b1-2360-4ed2-b147-9db77c41041d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.567886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b26b1-2360-4ed2-b147-9db77c41041d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.581014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b26b1-2360-4ed2-b147-9db77c41041d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-291b26b1-2360-4ed2-b147-9db77c41041d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:14.589485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:14.590395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:59:14.591181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:14.595128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 235/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:14.596627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:14.600611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:14.707627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579de58-1cbb-422c-94eb-69711455bbd8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:14.743183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffc787-0a14-4ffa-8e3b-b796c3b4f2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:14.743948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc787-0a14-4ffa-8e3b-b796c3b4f2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:14.744230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc787-0a14-4ffa-8e3b-b796c3b4f2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:14.744502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffc787-0a14-4ffa-8e3b-b796c3b4f2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:14.745247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc787-0a14-4ffa-8e3b-b796c3b4f2e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:14.745550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc787-0a14-4ffa-8e3b-b796c3b4f2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:14.746960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffc787-0a14-4ffa-8e3b-b796c3b4f2e8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:14.755774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 245/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:15.889558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b1e1-8860-43d6-b467-d0ce34feffdd None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:15.890042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b1e1-8860-43d6-b467-d0ce34feffdd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:15.890042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6b1e1-8860-43d6-b467-d0ce34feffdd None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:15.891625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 236/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:15.896901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7120e-2ecf-43c4-9a89-175d57318567 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:15.897296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7120e-2ecf-43c4-9a89-175d57318567 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:15.897458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7120e-2ecf-43c4-9a89-175d57318567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:15.920731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-23f7120e-2ecf-43c4-9a89-175d57318567 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:15.922399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-23f7120e-2ecf-43c4-9a89-175d57318567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:16.010540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:16.021134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 246/482] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:16.058541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6b1e1-8860-43d6-b467-d0ce34feffdd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:16.137262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:16.208621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6b1e1-8860-43d6-b467-d0ce34feffdd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:16.248638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:16.249445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.249729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.250004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.266936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:16.275320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:16.276253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:16.277027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:16.279467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 237/483] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:16.285364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7120e-2ecf-43c4-9a89-175d57318567 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:16.409585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7120e-2ecf-43c4-9a89-175d57318567 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:16.453464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ad217-7127-4f28-98d7-b685d8c3f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:16.454144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ad217-7127-4f28-98d7-b685d8c3f28b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.454425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ad217-7127-4f28-98d7-b685d8c3f28b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.454700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ad217-7127-4f28-98d7-b685d8c3f28b None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.455484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ad217-7127-4f28-98d7-b685d8c3f28b None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:16.455790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ad217-7127-4f28-98d7-b685d8c3f28b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:16.457168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ad217-7127-4f28-98d7-b685d8c3f28b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:16.473702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 247/484] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:16.479447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:16.609196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f03bb1-beb6-4612-a53e-3b2cafc3ca30 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:16.633576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:16.668525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef571d4-0906-4b69-859b-fccfb31deb02 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.668814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef571d4-0906-4b69-859b-fccfb31deb02 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.669093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef571d4-0906-4b69-859b-fccfb31deb02 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.670452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 248/485] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:59:16.671072 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:16.671883 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.672166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.672473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.676262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1c3c-0a9f-438d-9f99-77932445567d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.676546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1c3c-0a9f-438d-9f99-77932445567d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.676828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f1c3c-0a9f-438d-9f99-77932445567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.704721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:16.706217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:16.707829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1a8f1c3c-0a9f-438d-9f99-77932445567d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:16.709046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1a8f1c3c-0a9f-438d-9f99-77932445567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:16.737039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:16.737919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:16.738737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:16.738737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:16.738737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:16.738737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:16.738737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 238/486] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:16.744350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:16.823295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:16.850050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 249/487] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:16.883421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681e088-4f0e-4984-8776-260372425753 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.884065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681e088-4f0e-4984-8776-260372425753 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.884542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681e088-4f0e-4984-8776-260372425753 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.887239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 250/488] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:59:16.888372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681e088-4f0e-4984-8776-260372425753 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:16.901932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4828d76-13a2-4a83-8465-3dca922b1b5b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:16.938214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf63a9-4829-47f2-a1e7-69dbdcc14343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:16.938976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf63a9-4829-47f2-a1e7-69dbdcc14343 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.939271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf63a9-4829-47f2-a1e7-69dbdcc14343 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.939546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf63a9-4829-47f2-a1e7-69dbdcc14343 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.940283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf63a9-4829-47f2-a1e7-69dbdcc14343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:16.940594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf63a9-4829-47f2-a1e7-69dbdcc14343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:16.942042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf63a9-4829-47f2-a1e7-69dbdcc14343 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:16.955767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 239/489] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:16.957152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a273cc-6fcc-4432-a201-49cc1e132837 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:16.957610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a273cc-6fcc-4432-a201-49cc1e132837 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:16.958116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a273cc-6fcc-4432-a201-49cc1e132837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:16.975884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-58a273cc-6fcc-4432-a201-49cc1e132837 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:16.977329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-58a273cc-6fcc-4432-a201-49cc1e132837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:16.996372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.017185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681e088-4f0e-4984-8776-260372425753 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.057918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 240/490] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:17.059094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a273cc-6fcc-4432-a201-49cc1e132837 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.061208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.066860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.066860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.066860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.078862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:17.085129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:17.086012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:17.086799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:17.090963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 251/491] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:17.098497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.164804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.196891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a273cc-6fcc-4432-a201-49cc1e132837 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.234693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6375c-103e-4fb1-9a39-dbf8edd2d3a2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.236657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.237809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.238327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.238801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.248107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:17.249847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:17.268262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:17.269180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:17.270068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:17.272731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 241/492] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:17.272857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.273518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.273872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.274151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.274518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.274936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:17.275247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:17.276757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:17.291855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 252/493] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:17.291855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.296853 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.392338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a934f2-8993-4c15-afb8-b758edb68b82 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.404384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec36c20c-34dd-4557-8320-bedb337043c5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.415592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.428886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.429692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.429956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.430231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.440678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177e0dc-8971-40aa-b078-3be574a04c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.440929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:17.441348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177e0dc-8971-40aa-b078-3be574a04c71 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.441630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177e0dc-8971-40aa-b078-3be574a04c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.441906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177e0dc-8971-40aa-b078-3be574a04c71 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.442735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177e0dc-8971-40aa-b078-3be574a04c71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:17.443073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177e0dc-8971-40aa-b078-3be574a04c71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:17.445292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177e0dc-8971-40aa-b078-3be574a04c71 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:17.449467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:17.450328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:17.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 242/494] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:17.452386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.494213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 253/495] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:17.494213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56294e0-cd6b-438b-b11a-47f6274cf7ac None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.494213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56294e0-cd6b-438b-b11a-47f6274cf7ac None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.494213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56294e0-cd6b-438b-b11a-47f6274cf7ac None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.494213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 254/496] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:17.494213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56294e0-cd6b-438b-b11a-47f6274cf7ac None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.541686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.571439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd89da9-dcc9-4997-8fe4-d60ce70b623f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.604927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56294e0-cd6b-438b-b11a-47f6274cf7ac None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.609188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.609987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.610267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.610537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.623898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:17.623898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:17.642759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:17.643946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:17.644882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:17.644882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:17.644882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:17.644882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:17.644882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 243/497] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:17.644882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.652919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bda5f8-60de-449b-a2e9-ae676b50b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.653598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda5f8-60de-449b-a2e9-ae676b50b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.653881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda5f8-60de-449b-a2e9-ae676b50b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.654156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bda5f8-60de-449b-a2e9-ae676b50b5c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.654949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bda5f8-60de-449b-a2e9-ae676b50b5c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:17.655256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bda5f8-60de-449b-a2e9-ae676b50b5c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:17.656646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bda5f8-60de-449b-a2e9-ae676b50b5c7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:17.672952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 255/498] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:17.672952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb79806-4b35-4fe1-b73c-f7e8ce4507ed None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.672952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb79806-4b35-4fe1-b73c-f7e8ce4507ed None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.672952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb79806-4b35-4fe1-b73c-f7e8ce4507ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.688858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0eb79806-4b35-4fe1-b73c-f7e8ce4507ed None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:17.690056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0eb79806-4b35-4fe1-b73c-f7e8ce4507ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:17.715006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.752069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6673ae-6f12-496b-a1a7-15b5d761afcd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.758479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 256/499] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:17.759328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb79806-4b35-4fe1-b73c-f7e8ce4507ed None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.777620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.786622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc2ff2-f4de-4655-be84-fc226007a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.787323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2ff2-f4de-4655-be84-fc226007a624 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.787608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2ff2-f4de-4655-be84-fc226007a624 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.787884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc2ff2-f4de-4655-be84-fc226007a624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.854101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc2ff2-f4de-4655-be84-fc226007a624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:17.855572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc2ff2-f4de-4655-be84-fc226007a624 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:17.867506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb79806-4b35-4fe1-b73c-f7e8ce4507ed None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:17.901065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:17.901726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.902006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.902285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.903029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:17.903332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:17.904713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:17.916088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 257/500] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:17.916978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.940920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:17.953745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 244/501] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:17.955096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a247c-1ffa-4f87-9ce9-89e516db7b0a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:17.955385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a247c-1ffa-4f87-9ce9-89e516db7b0a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:17.955662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a247c-1ffa-4f87-9ce9-89e516db7b0a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:17.956907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 245/502] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:17.957583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a247c-1ffa-4f87-9ce9-89e516db7b0a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:17.988099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.026038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499599de-697c-4c04-b444-a72ffb4f606d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.059761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.060544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.060829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.061096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.065457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a247c-1ffa-4f87-9ce9-89e516db7b0a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.072149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.073601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:18.090156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:18.091012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:18.091942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:18.091942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:18.091942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.091942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:18.091942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 258/503] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:18.092202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.101326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.102124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.102411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.102690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.112995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:18.121304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:18.122152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 246/504] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:18.123341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.168997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.199510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961e95b-00b0-4f0b-95d4-a037517f89f1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.208556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.223825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836ef92-a3a5-4aea-9ae5-af7754e635bd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.232682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83109dc9-998f-4d8d-a30e-46b48c755dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.233474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83109dc9-998f-4d8d-a30e-46b48c755dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.233757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83109dc9-998f-4d8d-a30e-46b48c755dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.234026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83109dc9-998f-4d8d-a30e-46b48c755dd8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.241346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83109dc9-998f-4d8d-a30e-46b48c755dd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.242781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83109dc9-998f-4d8d-a30e-46b48c755dd8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.258713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-83109dc9-998f-4d8d-a30e-46b48c755dd8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:18.258925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:18.259926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 19:59:18.260845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:18.261436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.261436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.261436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.261613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 259/505] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:18.261613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52fcf-8eec-489d-adba-a92d77aae5c9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.261613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52fcf-8eec-489d-adba-a92d77aae5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.261774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd52fcf-8eec-489d-adba-a92d77aae5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.276028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.277488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.280003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6dd52fcf-8eec-489d-adba-a92d77aae5c9 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:18.281179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6dd52fcf-8eec-489d-adba-a92d77aae5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:18.294832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:18.295858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:18.296893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:18.296893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:18.296893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.296893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:18.296893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 247/506] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:18.296893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.352138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 260/507] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:18.353074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd52fcf-8eec-489d-adba-a92d77aae5c9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.408360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef1a00-008c-4b39-be06-228a1c6fd81f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.413234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.440947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.441607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.441899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.442178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.442928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:18.443239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.445377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.451871 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd52fcf-8eec-489d-adba-a92d77aae5c9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.452112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.457675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 248/508] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:18.458416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.485084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.486017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.486297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.486570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.487338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:18.487642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.489006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.497366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 261/509] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:18.498147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.560005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e24a2-179e-40ca-8ff7-cc8a64b4ad21 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.594182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.594878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.595154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.595430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.595937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa7fdd-a9dd-47c3-83fe-9b4855a930c6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.596262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:18.596570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.597989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.618603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.631194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.631581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.632398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.632686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.633404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:18.633705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.635104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.638264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 249/510] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:18.639134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.646919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 262/511] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:18.647750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.698914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.742176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a7de5-b90d-416b-9949-17a38b004155 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.746224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c08bcc-2a35-49f7-9b89-0cd4a27110ec None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.775809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.776605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.776892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.777163 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.779178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.779968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.780246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.780517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.787098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.787554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.788898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.789002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:18.804930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:18.805922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:18.806784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 263/512] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:18.807365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:18.808076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:18.809538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:18.809538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:18.809538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.809538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:18.809896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.810002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 250/513] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:18.810002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:18.857641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.906554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cb712-766f-430f-80e7-db034c53bf94 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.910255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a42038-c2d5-420d-9c3b-ad241f270826 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:18.916438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:18.941516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.942159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.942448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.942718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.944314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:18.945367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:18.945647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:18.945918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:18.955708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:18.957116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:18.974176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:18.975083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:18.976473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:18.976473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:18.976473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:18.976473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:18.976473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 264/514] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:18.976733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.009012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.010464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.068583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.075016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c886e-f75f-4c59-b158-d8920f9c86d6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.108962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 251/515] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:19.109801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.115823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.117226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.117505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.117775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.120214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.125313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.126749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:19.140807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:19.141634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:19.142468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 265/516] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:19.143148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.210166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921fed8-4247-4f98-8758-0d684f2921e0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.242072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973efe49-8ef7-4f99-903e-466947e868f2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.243259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.243919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.244198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.244476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.245302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:19.245608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.247078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.263751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 252/517] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:19.264524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.279090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.279748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.280029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.280304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.281013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:19.281320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.282663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.294627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 266/518] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:19.295439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.312542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.333019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.369538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c872e-9456-4b65-a791-8600969f7f48 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.399817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48418a-35a6-45b9-9f03-faaf31406dc8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.403117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.403782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.404070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.404348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.405071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:19.405379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.406777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.418797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 253/519] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:19.419605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.437273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.438067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.438352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.438627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.448873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.450354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:19.468138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:19.469103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:19.474475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:19.474475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:19.474475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:19.474475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:19.474475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 267/520] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:19.474475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.517494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e2559-4801-4e24-bc74-20c7352244cb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.537070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.541967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.550540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.551225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.551514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.551789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.552579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:19.552893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.554866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.571147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01432e13-40ec-4804-bbac-1cf10de43130 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.573574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 254/521] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:19.574351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.604053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.604700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.604970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.605239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.678264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7242a9-b035-4901-8b9b-9fb4f7b41a71 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.681971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.683838 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.716271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.716941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.717233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.717511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.718266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.719684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.739732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 255/522] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:59:19 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:19.740553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.757362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.795198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 268/523] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:19.796081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.823600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:19.892660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d626409-fcba-4933-986a-bae53ce6e5cd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.911781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ab1cd-0dd7-4418-844d-99be115f61d1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:19.934309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.935423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.935857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.936284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.944319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.946197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.952077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:19.953019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:19.953019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:19.953306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:19.954000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:19.954310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:19.955689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:19.961303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:19.962261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:19.963151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 256/524] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:19.963701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:19.974112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 269/525] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:19.974999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.005944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.089765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eceb39-7700-490e-84e6-27f0d8edf284 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.097134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac3ba2-ffb0-432b-9284-5d3b4c656853 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.098705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.127052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.127856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.128163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.128423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.134062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.135057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.135397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.135683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.136529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=e8a59979309a45f98c0b4fb27af83c6e) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:20.136846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.138410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.139087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.140539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.151046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 257/526] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/role_assignments?user.id=e8a59979309a45f98c0b4fb27af83c6e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:20.152379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:20.158895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:20.159915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:20.160753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:20.160753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:20.160753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:20.160753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:20.165470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 270/527] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:20.166965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.280259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.285883 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74803-aecb-44b1-8146-a30ba0ba6743 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.309242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb73fe-aed5-41b9-880a-9912d8f9cf70 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.331335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.332367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.333601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.334077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.336528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:20.337037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.339593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.369464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.370588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.371179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.371656 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.378313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 258/528] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:20.379356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.380297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.383680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:20.401239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:20.402134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:20.402993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:20.405492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 271/529] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:20.406482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.406707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.486159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdadabf-9f9c-4520-97ab-9cd2e9c7688d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.515924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec07a9-fcc2-49e3-885f-7c67651eaa58 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.523844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.525402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.525894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.526516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.527998 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:20.528812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.530792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.547930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 259/530] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:20.549067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.555982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.556705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.557048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.557386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.572231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.647088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.654242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.656691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.669413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f985c1-5495-40d4-b8c9-da48ba93c703 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.717811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.718690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.719088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.719427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.720286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:20.720661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.722334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.736048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 260/531] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:20.737046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.767710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 272/532] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:20.768572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.810521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.860546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f29175-968b-4b9b-aaa4-a614e47f48cc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.887906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39314cfe-70b0-4fb3-a307-b14fbd26755e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:20.897657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.898570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.898988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.899376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.906738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.908320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.927515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:20.927763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:20.929754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:20.931717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:20.932700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:20.932700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:20.932700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:20.932700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=8376ffaa09e2496a80fa60c979769d8b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:20.932700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:20.933340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 261/533] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:20.933476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:20.933634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:20.939511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:20.940961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 273/534] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/role_assignments?user.id=8376ffaa09e2496a80fa60c979769d8b&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:20.941806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:21.081627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c872e2-fc07-4cae-a062-3392e4a7dd3d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:21.092857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:21.123451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:21.124142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:21.124519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:21.124802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:21.125617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:21.125933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:21.127440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:21.148176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 274/535] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:21.155850 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:21.169658 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d94173-7249-4768-b38a-ea4cef028ad7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:21.218492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:21.219454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:21.219743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:21.220022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:21.244135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:21.245815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:21.264197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0043d70-4463-4619-8e71-eec7681994a5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:21.264683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:21.266595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:21.268736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:21.268736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:21.268736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:21.268736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:21.268736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 262/536] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:21.276045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:21.300806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:21.301466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:21.301793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:21.302074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:21.302941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=4225e82ea268483daa86078abb11c7f6) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:21.303254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:21.305326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:21.311579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 275/537] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:21 2022] GET /identity/v3/role_assignments?user.id=4225e82ea268483daa86078abb11c7f6&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:21.362412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:21.413940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d2801-3702-48de-8e31-1c3942189890 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:21.458101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:21.458788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:21.459095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:21.459373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:21.460775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:21.461087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:21.462482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:21.480293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 263/538] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:21.485323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:21.531993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:21.645484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c528b-4c09-49ff-9d31-145647890681 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:21.690351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:21.691493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:21.691783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:21.692061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:21.701735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:21.703312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:21.717534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:21.718410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:21.719297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 276/539] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:21.725925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:21.846751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94479b69-fb55-4f28-99bd-e726e0ef37f4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:21.864773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:21.890640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c254ef-7f0a-405d-b227-8299da46247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:21.891259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c254ef-7f0a-405d-b227-8299da46247a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:21.891544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c254ef-7f0a-405d-b227-8299da46247a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:21.891822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c254ef-7f0a-405d-b227-8299da46247a None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:21.892620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c254ef-7f0a-405d-b227-8299da46247a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:21.892932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c254ef-7f0a-405d-b227-8299da46247a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:21.894381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c254ef-7f0a-405d-b227-8299da46247a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:21.907295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 264/540] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:21.913610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:22.071120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:22.088133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b126d9-c07b-4250-a62d-a041892566c5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:22.143142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a92769-eb47-49a6-a689-b4e7b4c4a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:22.143743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92769-eb47-49a6-a689-b4e7b4c4a48e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:22.143996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92769-eb47-49a6-a689-b4e7b4c4a48e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:22.144274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a92769-eb47-49a6-a689-b4e7b4c4a48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:22.145115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a92769-eb47-49a6-a689-b4e7b4c4a48e None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=8751982010ae4b7eb6c855aea7540a23) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:22.145429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a92769-eb47-49a6-a689-b4e7b4c4a48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:22.146869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a92769-eb47-49a6-a689-b4e7b4c4a48e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:22.155245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 277/541] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:21 2022] GET /identity/v3/role_assignments?user.id=8751982010ae4b7eb6c855aea7540a23&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:22.298709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95e0a-b150-43ad-bee4-506bab54dd64 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:22.299272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95e0a-b150-43ad-bee4-506bab54dd64 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:22.299272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d95e0a-b150-43ad-bee4-506bab54dd64 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:22.300947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 265/542] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:22.315609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632478-de07-430c-8ad6-ef8821a7e7f6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:22.316023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632478-de07-430c-8ad6-ef8821a7e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:22.316292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632478-de07-430c-8ad6-ef8821a7e7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:22.336907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3a632478-de07-430c-8ad6-ef8821a7e7f6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:22.338123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3a632478-de07-430c-8ad6-ef8821a7e7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:22.437659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 278/543] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:22.464576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d95e0a-b150-43ad-bee4-506bab54dd64 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:22.603187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d95e0a-b150-43ad-bee4-506bab54dd64 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:22.654396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d810b3d-7959-467a-a7ea-ef95b4f48867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:22.655225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810b3d-7959-467a-a7ea-ef95b4f48867 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:22.655516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810b3d-7959-467a-a7ea-ef95b4f48867 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:22.655794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d810b3d-7959-467a-a7ea-ef95b4f48867 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:22.670549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d810b3d-7959-467a-a7ea-ef95b4f48867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1d810b3d-7959-467a-a7ea-ef95b4f48867 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:22.678562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:22.679951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:22.680720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 266/544] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:22.686257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632478-de07-430c-8ad6-ef8821a7e7f6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:22.777948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:22.796419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ad4b-eace-46f9-92da-9a5b45570186 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:22.797028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ad4b-eace-46f9-92da-9a5b45570186 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:22.797523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ad4b-eace-46f9-92da-9a5b45570186 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:22.799292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 267/545] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:22.805409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34274507-8fa1-4464-8ddc-4665b795785c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:22.805699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34274507-8fa1-4464-8ddc-4665b795785c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:22.805978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34274507-8fa1-4464-8ddc-4665b795785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:22.808705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632478-de07-430c-8ad6-ef8821a7e7f6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:22.836240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-34274507-8fa1-4464-8ddc-4665b795785c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:22.837436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-34274507-8fa1-4464-8ddc-4665b795785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:22.857172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:22.857857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:22.858143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:22.858418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:22.867430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:22.867744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:22.869128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:22.875216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:22.888756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 279/546] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:22.894191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:22.944884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 268/547] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:22.977292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34274507-8fa1-4464-8ddc-4665b795785c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.041680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc76b2d-97e5-449e-b949-5febf072806b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.080278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34274507-8fa1-4464-8ddc-4665b795785c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.108667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.109549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.109843 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.110122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.116633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.117427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.117708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.117985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.128678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:23.129420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:23.130957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:23.136997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:23.137937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:23.138719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 269/548] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:23.140293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:23.143916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:23.164609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:23.166338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:23.167355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:23.167355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:23.167355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:23.167355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:23.175405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 280/549] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:23.179109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:23.180763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.263245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc687a04-eb9f-412e-9d71-e07cd1998f10 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.304447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.306237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.306757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.307256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.308719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:23.309272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:23.310987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:23.322427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 270/550] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:23.327776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.423472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:23.445743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25947d3c-5d2f-42f3-a967-37919dfa1379 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.452157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00bd787-7955-46d2-a0ef-2aed69af90aa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.503375 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fbb25-47dd-4338-8199-d4a97512f034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.504241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbb25-47dd-4338-8199-d4a97512f034 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.504518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbb25-47dd-4338-8199-d4a97512f034 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.504790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbb25-47dd-4338-8199-d4a97512f034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.505442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4fe804-b681-44ee-8a69-bd5171b38e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.506194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fe804-b681-44ee-8a69-bd5171b38e05 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.506480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fe804-b681-44ee-8a69-bd5171b38e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.507404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fe804-b681-44ee-8a69-bd5171b38e05 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.508131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fe804-b681-44ee-8a69-bd5171b38e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:23.508435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fe804-b681-44ee-8a69-bd5171b38e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:23.509802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4fe804-b681-44ee-8a69-bd5171b38e05 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:23.522072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 281/551] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:23.523446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fbb25-47dd-4338-8199-d4a97512f034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:23.525220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fbb25-47dd-4338-8199-d4a97512f034 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:23.528103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256f73a-0f25-417b-8e49-9dd66d9968f0 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.528341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256f73a-0f25-417b-8e49-9dd66d9968f0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.528622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256f73a-0f25-417b-8e49-9dd66d9968f0 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.534064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 282/552] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:23.534064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256f73a-0f25-417b-8e49-9dd66d9968f0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-320fbb25-47dd-4338-8199-d4a97512f034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:23.552399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:23.553415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:23.554407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:23.554407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:23.554407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:23.554407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:23.554407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 271/553] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:23.555415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0649-7aeb-43dc-ad5d-e7fc94efee8b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.555415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0649-7aeb-43dc-ad5d-e7fc94efee8b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.555415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0649-7aeb-43dc-ad5d-e7fc94efee8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.584030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6dce0649-7aeb-43dc-ad5d-e7fc94efee8b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:23.586651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6dce0649-7aeb-43dc-ad5d-e7fc94efee8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:23.602592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:23.654733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256f73a-0f25-417b-8e49-9dd66d9968f0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.678944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 272/554] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:23.678944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0649-7aeb-43dc-ad5d-e7fc94efee8b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.721374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.723069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.723482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.723882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.734205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:23.736397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:23.758310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:23.759301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:23.760270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:23.763360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 283/555] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:23.765532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.778707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:23.812738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0649-7aeb-43dc-ad5d-e7fc94efee8b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.849692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.851229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.851662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.852086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.852949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:23.853400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:23.854950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:23.871171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 273/556] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:23.872242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.872775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e4696-6b24-4275-bb63-6c9e00d1a9a3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:23.890467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:23.911019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:23.912262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:23.912383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:23.912801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:23.925235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:23.933096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:23.934142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:23.935529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:23.940027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 284/557] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:23.940942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:23.985678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a604bf-b18c-4924-95d7-b7082c0eb4e4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.016438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.023206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.024103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.024820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.025395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.026438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:24.026960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.028595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.051157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2113c-adb0-4a74-b264-9f69267d8c76 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.051677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 274/558] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:24.052900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.095141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.095141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.095399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.095632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.105190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.106672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:24.123965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:24.125014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:24.125924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:24.129943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 285/559] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 19:59:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:24.131144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.169559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300f51c-aea1-4493-86c3-62cc099255c8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.171346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.205977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.206805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.207225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.207687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.208671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:24.208990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.210505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.223301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 275/560] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:24.223301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.252980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58908520-63e6-46ca-9d2c-00f66b153984 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.272398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.289971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8e83b-02fd-47b1-92b6-00111dc52757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.290901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e83b-02fd-47b1-92b6-00111dc52757 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.291053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e83b-02fd-47b1-92b6-00111dc52757 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.291203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8e83b-02fd-47b1-92b6-00111dc52757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.338315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664b4da-092c-46cb-9f26-e97b52bf61d6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.389089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8e83b-02fd-47b1-92b6-00111dc52757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.390672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8e83b-02fd-47b1-92b6-00111dc52757 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.392174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.393049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.393498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.393947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.395149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:24.395591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.397150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.421885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 276/561] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:24.421885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.427763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.498713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 286/562] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:24.500415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0ff-6b01-4215-9fe5-b909616245e5 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.500776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0ff-6b01-4215-9fe5-b909616245e5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.501131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5a0ff-6b01-4215-9fe5-b909616245e5 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.502626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 287/563] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:24.503256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a0ff-6b01-4215-9fe5-b909616245e5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.533703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02954f6-0b2c-40d5-a6f7-fe5b7e760eb9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.544755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.574049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d685efb-e539-48fa-a013-598d9899abd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.574885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685efb-e539-48fa-a013-598d9899abd9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.575163 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685efb-e539-48fa-a013-598d9899abd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.575445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d685efb-e539-48fa-a013-598d9899abd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.586714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d685efb-e539-48fa-a013-598d9899abd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.588239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d685efb-e539-48fa-a013-598d9899abd9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2d685efb-e539-48fa-a013-598d9899abd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:24.606526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:24.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:24.608541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:24.608541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:24.608541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:24.608541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:24.608541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 277/564] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:24.609065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39307c54-e3cd-4107-b388-c9f5ff701ae8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.609350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39307c54-e3cd-4107-b388-c9f5ff701ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.609625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39307c54-e3cd-4107-b388-c9f5ff701ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.626707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-39307c54-e3cd-4107-b388-c9f5ff701ae8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:24.627263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5a0ff-6b01-4215-9fe5-b909616245e5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.627939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-39307c54-e3cd-4107-b388-c9f5ff701ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:24.668213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.668996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.669280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.669555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.672710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.681949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.683819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.707753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 278/565] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:24.707753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39307c54-e3cd-4107-b388-c9f5ff701ae8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:24.708012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:24.708909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:24.710319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:24.710319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:24.710319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:24.710319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:24.710319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 288/566] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:24.710319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.801976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.811945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39307c54-e3cd-4107-b388-c9f5ff701ae8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.814602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fca58e-f3a1-413d-987d-7c74531c22fb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.845892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.846681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.847003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.847287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.851663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:24.852411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:24.852754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:24.853041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:24.853848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:24.854169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.855836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.862132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:24.863600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:24.867808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 289/567] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:24.868605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:24.882343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:24.883505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:24.884639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:24.884639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:24.884639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:24.884639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:24.884639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 279/568] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:24.884639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:24.919249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:24.971505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ed76b-1bfd-4e1e-b2c2-02c40dadb84b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:24.987243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d739faf-e8f5-4501-b197-0e59d7e5947a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.005680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419b982-52e4-4729-a4ba-1b5ed1023f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.006371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419b982-52e4-4729-a4ba-1b5ed1023f0e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.007185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419b982-52e4-4729-a4ba-1b5ed1023f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.007463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419b982-52e4-4729-a4ba-1b5ed1023f0e None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.008227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419b982-52e4-4729-a4ba-1b5ed1023f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:25.008587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419b982-52e4-4729-a4ba-1b5ed1023f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.009968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419b982-52e4-4729-a4ba-1b5ed1023f0e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.021351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 290/569] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:25.023241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8b2a-126f-4bf4-88f9-ccf308e1bd53 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.023530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8b2a-126f-4bf4-88f9-ccf308e1bd53 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.023806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8b2a-126f-4bf4-88f9-ccf308e1bd53 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.025027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 291/570] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:25.025713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c8b2a-126f-4bf4-88f9-ccf308e1bd53 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.027120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.027917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.028197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.028469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.039339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:25.047108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:25.048244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 280/571] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:25.049308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.051601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.129282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c8b2a-126f-4bf4-88f9-ccf308e1bd53 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.138719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.150048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9e321-387a-49ad-9285-9f31bba899b8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.168155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.168953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.169239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.169564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.176910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.178342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.183533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd56330-079b-4ee7-bdd2-7c0678d992ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.184196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd56330-079b-4ee7-bdd2-7c0678d992ce None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.184480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd56330-079b-4ee7-bdd2-7c0678d992ce None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.184759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd56330-079b-4ee7-bdd2-7c0678d992ce None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.185479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd56330-079b-4ee7-bdd2-7c0678d992ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:25.185789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd56330-079b-4ee7-bdd2-7c0678d992ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.187196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd56330-079b-4ee7-bdd2-7c0678d992ce None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:25.192389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:25.193442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 292/572] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:25.195218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.204233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 281/573] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:25.205347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f82f9-00a8-47ac-bd96-88aa123eadbc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.205644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f82f9-00a8-47ac-bd96-88aa123eadbc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.205921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f82f9-00a8-47ac-bd96-88aa123eadbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.222178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-102f82f9-00a8-47ac-bd96-88aa123eadbc None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:25.223441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-102f82f9-00a8-47ac-bd96-88aa123eadbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:25.281443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.292552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 282/574] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:25.293339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f82f9-00a8-47ac-bd96-88aa123eadbc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.297309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca4b9b-fc79-4f5b-a53b-96f411e34d8d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.332427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.333230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.333515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.333793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.340972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.342407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:25.357091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:25.358008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:25.358918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 293/575] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:25.359459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.386833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.408068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f82f9-00a8-47ac-bd96-88aa123eadbc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.442145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.442751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.443059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.443334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.444075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:25.444379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.445995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.453873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 283/576] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:25.454666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.460260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab80dea-c5b4-46e3-8d79-77f296eff3aa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.495521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.496189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.496471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.496748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.497575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:25.497883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.499351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.509707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.516696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 294/577] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:25.517486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.554804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e8e82-57d2-45bf-94f5-1139d2ccb766 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.588604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.589397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.589685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.589964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.596713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.598142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.599751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:25.612843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:25.613812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:25.614662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 284/578] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:25.615484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b34cd6-ae29-4e92-bca5-2dee15afb606 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.615590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.651519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.652332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.654183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.654183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.667740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:25.675649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:25.676700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:25.677525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 295/579] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:25.678214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.727016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c3ad45-4415-4161-a695-099d93ce332a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.740779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.760992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.761927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.762210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.762485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.763289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:25.763596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.765012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.776450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 285/580] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:25.777229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.784877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280592b2-e438-4d81-abdd-4b8555229527 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.818148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.819008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.819298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.819811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.830097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.831554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.838079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:25.849589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:25.851067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:25.851950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:25.851950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:25.851950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:25.851950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:25.855113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 296/581] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:25.855922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.877327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f4c917-6947-45bc-b325-b159a351a96b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.909543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.910340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.910631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.910938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.921725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.923195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:25.940578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:25.941547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:25.942440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:25.942440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:25.942440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:25.942440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:25.942440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 286/582] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:25.942721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:25.956968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2741a8-bda4-4959-aeaf-b6043726b8f7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:25.969538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:25.991693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:25.992296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:25.992582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:25.992865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:25.993650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:25.993963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:25.995432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.007338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 297/583] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:26.008099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.048238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e9a19-861a-45ea-a5e7-a0e4abbe0833 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.065460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.080945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.081616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.081904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.082192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.082972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:26.083285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.085164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.093137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 287/584] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:26.093840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.107261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f086261-d940-442e-b9b8-1e11ace2add4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.139375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.140251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.140528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.140801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/e8a59979309a45f98c0b4fb27af83c6e/roles/8c8136abf46a401b83db6fa1665441a3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.155087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=e8a59979309a45f98c0b4fb27af83c6e, role_id=8c8136abf46a401b83db6fa1665441a3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.156506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.169182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 298/585] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:26 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/e8a59979309a45f98c0b4fb27af83c6e/roles/8c8136abf46a401b83db6fa1665441a3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:26.169969 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.181702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.197519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde2af9a-8e4a-4548-a984-12a8f611f480 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.234873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.235560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.235852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.236128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.236877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:26.237187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.238580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.251399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 288/586] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:26.252182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.302186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e5301-c5e4-455e-a904-8064e2b87e38 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.312673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.343292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.344014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.344296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.344565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.345295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:26.345596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.347008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.364649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 299/587] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:26.365491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.375632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f43d00-a2e7-4910-aa74-0049889b57cc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.416036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.416698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.416975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.417259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.418080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=b80af2efebf440959ceb238bd27cf7f2) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:26.418397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.419855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.425831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 289/588] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/role_assignments?user.id=b80af2efebf440959ceb238bd27cf7f2&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:26.430874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.449877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.499510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43600c1-01a9-4d29-9e6b-fddac389e614 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.548393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.549604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.550178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.550465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.558478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b2953-2a94-4c92-8679-5af8c889fc8b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.565900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.568024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:26.593659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:26.594604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:26.595531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:26.595531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:26.595531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:26.595531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:26.599596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 300/589] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:26.600569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.602273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.603172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.603757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.604042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.615970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.618950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.635704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:26.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:26.640358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:59:26.641459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:26.644537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 290/590] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:26.645903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.730677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.734522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d5dd75-1035-4d6a-830e-2d8761ef58f8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.762568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1466d2-8489-456d-9095-fa9df7926299 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.773753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.774833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.775322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.775897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.783680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.785439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.797047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.797719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.798000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.798275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.799073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:26.799322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.800674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:26.803276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:26.804666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:26.805561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:26.808175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 301/591] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:26.809232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.813997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 291/592] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:26.814281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.899537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.915733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b6bbc-cca2-4b59-a3a7-5271a5482c6c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.921709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23585e9d-f44f-42a3-8e7a-4f8d85a481f4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:26.947117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:26.953162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.954153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.954457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.955170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.956185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:26.956811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.958490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.971109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:26.971799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:26.972086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:26.972369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:26.973216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:26.973526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:26.975041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:26.983409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 292/593] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:26.984767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:26.999971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 302/594] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:27.001015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.103897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1aaa5-521e-4126-8dd0-4d8d099d78f7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.120010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129db892-1941-4266-9864-edd9a8a79ef5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.139040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.139981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.140360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.140731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.148551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.150081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.157546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.158433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.158714 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.159017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/8376ffaa09e2496a80fa60c979769d8b/roles/8c8136abf46a401b83db6fa1665441a3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:27.166447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:27.167401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:59:27.168498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:27.169541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:27.171444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 293/595] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:27.174861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.175827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=8376ffaa09e2496a80fa60c979769d8b, role_id=8c8136abf46a401b83db6fa1665441a3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.177391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.193315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 303/596] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:26 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/8376ffaa09e2496a80fa60c979769d8b/roles/8c8136abf46a401b83db6fa1665441a3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:27.194409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.261598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:27.313010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1799508c-3c74-4d71-a9a3-7c30577da02a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.356860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.357463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.357744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.358018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.358997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:27.359306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.360792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.381171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 304/597] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:27.386859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.405607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab9558-b190-4584-865e-fdecc28f28b6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.463318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:27.487879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.488679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.488958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.489227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.503109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.504563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:27.524820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:27.525740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:27.527166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:27.527166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:27.527166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:27.527166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:27.527166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 294/598] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:27.531615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.534149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603d7f1-3437-4ea1-b753-752aff0df8a9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.578067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.579281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.579892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.580543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.594158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.596087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:27.622108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:27.624013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:27.625107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:27.625107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:27.625107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:27.625107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:27.625107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 305/599] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:27.635824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.652281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb66ac7-2a6f-4bdf-88c2-47d4f5fd309b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.657044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:27.721807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.722543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.722922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.723201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.723932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:27.724234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.725643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.751051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 295/600] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:27.759996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.836079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:27.844942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba147ca-8b61-4192-9300-69328ee7927a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.869464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b952cc-a2a1-4170-85a0-cd4149751261 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:27.901960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.902556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.902867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.903144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.906695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:27.906695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.906695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.917469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 306/601] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:27.919815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:27.920857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:27.921366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:27.921925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:27.922867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:27.940147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:27.942131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:27.972471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:27.973402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:27.974285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:27.976529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 296/602] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:27.981844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:28.025830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1e1c-bbdb-4f07-8483-7c4b3a2c70a4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:28.037152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:28.060208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:28.061010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.061299 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.061573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.068582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:28.070830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:28.086599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:28.087553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:28.088862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 307/603] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:28.093477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:28.115849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:28.204901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a7c0-b17e-441b-b092-01d32d5fa855 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:28.233618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26660785-2342-4d73-8b86-aa5dc394d593 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:28.245739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:28.246414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.246700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.247010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.247804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:28.248112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:28.249644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:28.266962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 308/604] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:28.270929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:28.304674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:28.305711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.306224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.306711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.307743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:28.308271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:28.309921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:28.336768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 297/605] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:28.342873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:28.368789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:28.411790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac383f-ff1f-4dcc-8467-c4abc0b07533 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:28.450541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721160-f20e-41c2-814e-c8428b3e0259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:28.451963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721160-f20e-41c2-814e-c8428b3e0259 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.452478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721160-f20e-41c2-814e-c8428b3e0259 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.452971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721160-f20e-41c2-814e-c8428b3e0259 None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/8751982010ae4b7eb6c855aea7540a23/roles/8c8136abf46a401b83db6fa1665441a3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.469728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721160-f20e-41c2-814e-c8428b3e0259 None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=8751982010ae4b7eb6c855aea7540a23, role_id=8c8136abf46a401b83db6fa1665441a3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:28.471520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721160-f20e-41c2-814e-c8428b3e0259 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:28.498508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 309/606] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:28 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/8751982010ae4b7eb6c855aea7540a23/roles/8c8136abf46a401b83db6fa1665441a3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:59:28.537495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:28.554660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d7a07-7783-4214-83df-a96e7d1700f5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:28.592827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62209faa-d34b-488f-a004-65bba589ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:28.594139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209faa-d34b-488f-a004-65bba589ac9b None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.594658 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209faa-d34b-488f-a004-65bba589ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.595195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209faa-d34b-488f-a004-65bba589ac9b None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/4225e82ea268483daa86078abb11c7f6/roles/8c8136abf46a401b83db6fa1665441a3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.611554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62209faa-d34b-488f-a004-65bba589ac9b None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=4225e82ea268483daa86078abb11c7f6, role_id=8c8136abf46a401b83db6fa1665441a3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:28.613367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62209faa-d34b-488f-a004-65bba589ac9b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:28.652113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 298/607] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:28 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/4225e82ea268483daa86078abb11c7f6/roles/8c8136abf46a401b83db6fa1665441a3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:28.674399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be026d-2aea-4622-aa79-e9e254cd3a76 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.675098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be026d-2aea-4622-aa79-e9e254cd3a76 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.675603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be026d-2aea-4622-aa79-e9e254cd3a76 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.677774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 310/608] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:28.685481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffce944-fe83-4fa9-8b63-033f2ac6b207 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.686514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffce944-fe83-4fa9-8b63-033f2ac6b207 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.687196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffce944-fe83-4fa9-8b63-033f2ac6b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.707180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cffce944-fe83-4fa9-8b63-033f2ac6b207 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:28.708806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cffce944-fe83-4fa9-8b63-033f2ac6b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:28.791060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 299/609] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:28.814718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be026d-2aea-4622-aa79-e9e254cd3a76 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:28.902965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f61347-5b3b-4f52-9849-3a8c59ab1676 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.903600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f61347-5b3b-4f52-9849-3a8c59ab1676 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.904084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f61347-5b3b-4f52-9849-3a8c59ab1676 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.908919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 300/610] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:59:28.926763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783e91a-35d1-43a6-88bc-18b8b235f4e6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.927415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783e91a-35d1-43a6-88bc-18b8b235f4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.927960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783e91a-35d1-43a6-88bc-18b8b235f4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.939145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be026d-2aea-4622-aa79-e9e254cd3a76 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:28.961244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c783e91a-35d1-43a6-88bc-18b8b235f4e6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:28.962728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c783e91a-35d1-43a6-88bc-18b8b235f4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:28.981709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:28.982531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:28.982818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:28.983569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:28.995298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:29.000420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:29.012961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:29.014097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:29.015150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:29.017553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 311/611] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:29.023736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.080402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:29.108521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 301/612] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:29.132206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68e92e-ece3-475f-880e-23231ed94faf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:29.135894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783e91a-35d1-43a6-88bc-18b8b235f4e6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.170584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:29.171635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:29.172115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:29.172532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:29.173463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:29.173907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:29.175789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:29.184860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 312/613] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:29.190126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.280606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783e91a-35d1-43a6-88bc-18b8b235f4e6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:29.321798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:29.323045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:29.323610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:29.323921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:29.332494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:29.337662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:29.345756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:29.346743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:29.347619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 302/614] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:29.355811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.421225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:29.449596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c371611-64fd-4748-916d-e7a108f89869 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:29.473329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03cad-0bfe-42e9-adc5-435007cdac55 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:29.510514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:29.511287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:29.511976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:29.512632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:29.513702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:29.514128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:29.515776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:29.525989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 303/615] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:29.531928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.547550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:29.548621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:29.549054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:29.549480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:29.587819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:29.589528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:29.638762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ad3d4-7670-4ad0-8a50-24db56b8bb0d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:29.644477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:29.645353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:29.646205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:29.646205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:29.646205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:29.646205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:29.655295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 313/616] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:29.660497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.661200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:29.675680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:29.676550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:29.676836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:29.677113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:29.689142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:29.690660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:29.711642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:29.712545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:29.713407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:29.713407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:29.713407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:29.713407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:29.713619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 304/617] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:29.719240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.829502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0155f14-4b74-4185-832c-301e986bf810 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:29.865174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:29.866370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:29.866661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:29.879287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:29.880155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:29.880473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:29.882451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:29.883182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a8f03-c0be-4daa-93dc-969be9065d46 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:29.884738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:29.905829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 305/618] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:29.916062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.926785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:29.927481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:29.927790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:29.928029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:29.929294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:29.929599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:29.931040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:29.957344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 314/619] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:29.960173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:29.987233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:30.114147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26935f-d54d-4316-8fce-d65a83fa707a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.153579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646615f1-7416-47f5-a2a7-482e06012084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.154301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646615f1-7416-47f5-a2a7-482e06012084 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.154594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646615f1-7416-47f5-a2a7-482e06012084 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.154899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646615f1-7416-47f5-a2a7-482e06012084 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.163323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646615f1-7416-47f5-a2a7-482e06012084 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:30.164796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646615f1-7416-47f5-a2a7-482e06012084 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-646615f1-7416-47f5-a2a7-482e06012084 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:30.181430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:30.182499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:30.183537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 306/620] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:30.184131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fded10-3f4c-4b64-abf3-0b240968a863 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.184788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fded10-3f4c-4b64-abf3-0b240968a863 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.184788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fded10-3f4c-4b64-abf3-0b240968a863 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.185028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf65d2-9b1f-4919-8e0d-a20f93abf216 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.186272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 307/621] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:30.191774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fded10-3f4c-4b64-abf3-0b240968a863 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:30.220486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36dea8-f7fd-4601-ad8e-1a687d26beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.221285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dea8-f7fd-4601-ad8e-1a687d26beca None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.221568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dea8-f7fd-4601-ad8e-1a687d26beca None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.221845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36dea8-f7fd-4601-ad8e-1a687d26beca None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.230527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36dea8-f7fd-4601-ad8e-1a687d26beca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:30.232024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36dea8-f7fd-4601-ad8e-1a687d26beca None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fc36dea8-f7fd-4601-ad8e-1a687d26beca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:30.247144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:30.248999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 315/622] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 19:59:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9863d-298c-453e-a2d1-f948c6bfaf3d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.251040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9863d-298c-453e-a2d1-f948c6bfaf3d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.252651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9863d-298c-453e-a2d1-f948c6bfaf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.270920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-87c9863d-298c-453e-a2d1-f948c6bfaf3d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:30.272303 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-87c9863d-298c-453e-a2d1-f948c6bfaf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:30.293821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:30.301130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:30.320180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fded10-3f4c-4b64-abf3-0b240968a863 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.367012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 316/623] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:30.367897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9863d-298c-453e-a2d1-f948c6bfaf3d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:30.368673 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.369748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.370034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.370312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.372928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:30.373245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:30.374682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:30.402370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 308/624] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:30.403243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:30.508935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4c13b-5097-460c-be22-2f6cbf2d7230 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.514634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9863d-298c-453e-a2d1-f948c6bfaf3d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.545306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.546116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.546399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.546675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.558336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:30.558606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.559050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.559331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.559602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.560434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:30.560736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:30.562153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:30.566458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:30.568544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 309/625] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:30.570827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:30.580108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:30.588776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 317/626] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:30.589457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:30.605149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:30.687563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d076b3-33dd-492c-ade1-c4e59972fbf6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.724053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.725843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.726384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.726890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.727087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc248e5-3454-4c1a-bb11-367418fc0b0a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.739121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:30.740920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:30.760583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:30.761502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:30.762389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:30.762389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:30.762389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:30.762389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:30.764919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 310/627] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:30.765959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:30.776530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.777731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.778017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.778290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.779066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:30.779369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:30.781189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:30.794923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 318/628] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:30.796074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:30.838190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:30.883453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:30.897895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e7371c-00bd-401a-acfd-e48f46618384 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.926287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497f885-80c7-4439-b106-0433b0b6c97d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:30.945646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.946559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.946870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.947147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.966131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:30.967180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:30.967664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:30.968155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:30.969124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:30.969652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:30.971254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:30.984222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 319/629] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:30.985286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.051957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.053501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.094430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec9f8f-6dff-47ff-ad74-a2f52f60aa13 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.120593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.129038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.136174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18e7f9-67ec-487e-8f76-239d18b2055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.137022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e7f9-67ec-487e-8f76-239d18b2055f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.137310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e7f9-67ec-487e-8f76-239d18b2055f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.137585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18e7f9-67ec-487e-8f76-239d18b2055f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.150227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18e7f9-67ec-487e-8f76-239d18b2055f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.151828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18e7f9-67ec-487e-8f76-239d18b2055f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.167479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 311/630] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:31.168574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ae18e7f9-67ec-487e-8f76-239d18b2055f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:31.169927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:31.170764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:31.171696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:31.171696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:31.171696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:31.171696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:31.174977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 320/631] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:31.176513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647735-dc37-48e2-8836-0c59f9ccae61 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.176797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647735-dc37-48e2-8836-0c59f9ccae61 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.177071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647735-dc37-48e2-8836-0c59f9ccae61 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.178512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 321/632] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:31.186801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647735-dc37-48e2-8836-0c59f9ccae61 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.283580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819414de-fc3d-464b-92b2-e7db844b7b1b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.297668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647735-dc37-48e2-8836-0c59f9ccae61 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.317359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.318084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.318366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.318640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.326861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.328313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.332007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec88792-cb71-46c1-9de3-bb40f20fbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.332801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88792-cb71-46c1-9de3-bb40f20fbb45 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.333085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88792-cb71-46c1-9de3-bb40f20fbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.333361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec88792-cb71-46c1-9de3-bb40f20fbb45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:31.341833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:31.342769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:31.343709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 312/633] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:31.344212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec88792-cb71-46c1-9de3-bb40f20fbb45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.344283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.344839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec88792-cb71-46c1-9de3-bb40f20fbb45 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.362700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fec88792-cb71-46c1-9de3-bb40f20fbb45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:31.364533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:31.365434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:31.366904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:31.366904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:31.366904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:31.366904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:31.366904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 322/634] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:31.367717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79a240-ad98-493b-be9e-050e17cae09b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.368002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79a240-ad98-493b-be9e-050e17cae09b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.368281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79a240-ad98-493b-be9e-050e17cae09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.384758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-af79a240-ad98-493b-be9e-050e17cae09b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:31.385943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-af79a240-ad98-493b-be9e-050e17cae09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:31.420196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.450577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b219d-f566-4e40-ae27-41292a572482 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.458613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 323/635] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:31.459987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a07b9-9d72-42a5-b3bd-9486bce2d45c None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.460276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a07b9-9d72-42a5-b3bd-9486bce2d45c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.460569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a07b9-9d72-42a5-b3bd-9486bce2d45c None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.461827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 324/636] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:31.462511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a07b9-9d72-42a5-b3bd-9486bce2d45c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.491722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.492389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.492672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.492948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.493662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:31.493969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.495353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.507349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 313/637] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:31.508140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.573462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a07b9-9d72-42a5-b3bd-9486bce2d45c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.585435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.606150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492a5ee-65fa-41ac-80dc-97cd15bd41ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.606310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c95fc-6664-4319-8cc6-f6b47a610d2b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.606802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492a5ee-65fa-41ac-80dc-97cd15bd41ae None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.607115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492a5ee-65fa-41ac-80dc-97cd15bd41ae None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.607393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492a5ee-65fa-41ac-80dc-97cd15bd41ae None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.608178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492a5ee-65fa-41ac-80dc-97cd15bd41ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:31.608491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492a5ee-65fa-41ac-80dc-97cd15bd41ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.609933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6492a5ee-65fa-41ac-80dc-97cd15bd41ae None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.626424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 325/638] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:31.626424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbc41-dd14-4ddf-8968-2d167ee49f0e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.626424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbc41-dd14-4ddf-8968-2d167ee49f0e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.626424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbbc41-dd14-4ddf-8968-2d167ee49f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.641644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-88fbbc41-dd14-4ddf-8968-2d167ee49f0e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:31.642861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-88fbbc41-dd14-4ddf-8968-2d167ee49f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:31.645867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.646533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.646814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.647117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.647832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:31.648138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.649487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.660517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 314/639] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:31.661283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.663233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.710954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 326/640] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:31.711780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbbc41-dd14-4ddf-8968-2d167ee49f0e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.770219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd95498-ba7e-4e2a-a86c-ce7b70bcd955 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.804135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.804926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.805205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.805480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.811657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbbc41-dd14-4ddf-8968-2d167ee49f0e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.812039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.816391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:31.824879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:31.825846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 315/641] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:31.831941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.845880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.846681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.846998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.847278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.854787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.856259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:31.871137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:31.872218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:31.873154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 327/642] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:31.873755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:31.890210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:31.931963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440c749-1cd8-4396-a8c4-af29f3f7ca4d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.967484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:31.968370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:31.968655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:31.968941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/b80af2efebf440959ceb238bd27cf7f2/roles/8c8136abf46a401b83db6fa1665441a3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:31.971662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b85c00a-2d3d-4866-bce1-072666572be1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:31.983068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=b80af2efebf440959ceb238bd27cf7f2, role_id=8c8136abf46a401b83db6fa1665441a3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:31.984513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:31.998914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 316/643] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:31 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/b80af2efebf440959ceb238bd27cf7f2/roles/8c8136abf46a401b83db6fa1665441a3 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:31.999706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.005936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.007407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.007693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.007972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.015834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.017418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:32.032805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:32.033799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 328/644] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:32.035309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.073487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.125887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.138332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0e62f-d7a7-4db3-b690-71bd9afb5692 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.151897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68264c7e-71c6-412b-86fc-3332b9668d12 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.178033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.178931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.179432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.179541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.192672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:32.193821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.195297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.195581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.196481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.196589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:32.196887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.198251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:32.201936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:32.203092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:32.204272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 317/645] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:32.205166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.210875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 329/646] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:32.210875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.313299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b27929-800b-4067-886b-cb10527350f6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.323063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.330285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e0e25-5122-440b-97f5-d849e2cd2d24 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.348878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.349559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.349846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.350154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.351028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:32.351341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.352777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.369443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.370377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.370869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.371346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.372310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 318/647] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:32.372496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:32.372974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.373132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.374733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.383758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.395154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 330/648] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:32.395802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.483315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df80ea-651a-4ab5-9686-123f995ccbe7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.507742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babe6fe-72ac-4f27-a7e4-98d6b7e4ceac None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.517665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.518346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.518632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.518949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.519711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:32.520021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.521415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.534605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 319/649] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:32.534605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.553890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.554793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.555171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.555521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.562884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.567043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.568526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:32.588134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:32.589688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:32.590789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:32.590789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:32.590789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:32.590789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:32.596233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 331/650] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:32.596233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.649147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.654457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fda24-3c65-4f47-bf0f-402f936e3dc4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.693515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.694669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.695162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.695628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.702344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad42b62-8b9a-45ed-b5a9-f2129d461999 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.739067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.739733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.740017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.740322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.741720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=e8a59979309a45f98c0b4fb27af83c6e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:32.742030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.743495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.750870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 332/651] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/role_assignments?user.id=e8a59979309a45f98c0b4fb27af83c6e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:32.750870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.791968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.794294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.827959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.902329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d618e21-0fa2-4f2f-b9f2-8d6a5a916ec2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:32.917616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 320/652] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:32.918619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:32.921213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:32.950152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:32.951027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:32.951317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:32.952390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:32.967154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:32.968621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:32.992514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:32.993494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:32.994375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:32.994375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:32.994375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:32.994375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:32.994375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 333/653] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:32.994375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.059816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671fb5f-8f55-4d80-af78-5a8a04e79e30 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.088964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:33.097774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.098459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.098747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.099070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.099876 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:33.100156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.102083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.117798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 321/654] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:33.118975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.127363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16320fd8-dad0-4706-86ba-16c04b0548aa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.165831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.166660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.166980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.167260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.179592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.181174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:33.203094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:33.204199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:33.205256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:33.205256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:33.205256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:33.205256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:33.205256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 334/655] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:33.210874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.231141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:33.243432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009b0404-e5b0-4e06-a092-f955cc9930b3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.291824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.292551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.292835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.293114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.293853 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:33.294165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.296533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.313268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 322/656] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:33.314862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.328059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf5ead-3ded-4a51-98fa-e44b19ca43b8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.364302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.365110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.365448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.366300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.374715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.376224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.379672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:33.393356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:33.395489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 335/657] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:33.397692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.454336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f693f-7fa2-4e4b-ac82-c379aede2934 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.487709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.488383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.488674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.488953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.489684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:33.489995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.492016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.504509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:33.508334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 323/658] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:33.509251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.536041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b024af-91b4-46f1-a6a3-c976784c4627 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.583410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.584221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.585070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.585345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.593537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.595106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:33.610712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:33.612868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 336/659] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:33.615048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.621720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3ceff0-257c-468b-9dd4-1e28c97e47df None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.633760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:33.665890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.666608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.666919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.667206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.668056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:33.668373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.669816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.688567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 324/660] 10.222.0.48 () {56 vars in 1139 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:33.689427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.730825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640db05b-b2d5-44e7-842d-a8e0d8ef1b44 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.767154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.767965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.768249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.768852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.777080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.778543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.780416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:33.796877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:33.797989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:33.799081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:33.799516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b1e01-18fc-4e8d-89b4-f90cf3dfdf9a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.806011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 337/661] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:33.807102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.834025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.835278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.835567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.836474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.836703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:33.837258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:33.838516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:33.857708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 325/662] 10.222.0.48 () {56 vars in 1137 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:33.858584 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:33.884825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:33.919210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1155c-8b0a-4923-8c74-959551575b48 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:33.955913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:33.956894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:33.957338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:33.957809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:33.965549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1648dc4-791f-4e29-b383-0b90af1f83db None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.001101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.001680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.001963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.002243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.003060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:34.003374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.004808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.017454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 326/663] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:34.018259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.029948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.034317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.036033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.111891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.129849 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23db85c-b069-41e3-b75c-78235b1df034 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.152674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 338/664] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:34.154000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.166632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358b241-66ee-4594-8f39-99b1513ab896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.167131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358b241-66ee-4594-8f39-99b1513ab896 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.167442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358b241-66ee-4594-8f39-99b1513ab896 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.167716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358b241-66ee-4594-8f39-99b1513ab896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.237685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358b241-66ee-4594-8f39-99b1513ab896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.239180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358b241-66ee-4594-8f39-99b1513ab896 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.258572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.263274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921be143-3349-407c-b088-f9f441a873a2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.300219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.300883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.301169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.301442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.302265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=8376ffaa09e2496a80fa60c979769d8b) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:34.302573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.304573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.311116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 339/665] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/role_assignments?user.id=8376ffaa09e2496a80fa60c979769d8b&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:34.315803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.331158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.365011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 327/666] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:34.368031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622a7d-7a2c-4f86-b314-1f5ed8827f64 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.368566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622a7d-7a2c-4f86-b314-1f5ed8827f64 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.369318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94622a7d-7a2c-4f86-b314-1f5ed8827f64 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.371774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 328/667] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:34.373129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94622a7d-7a2c-4f86-b314-1f5ed8827f64 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.457560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fea3f1-2b90-4a00-8bde-8bc93b1d6ce5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.510541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94622a7d-7a2c-4f86-b314-1f5ed8827f64 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.514538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14db0ee3-8792-4055-9a71-67d0921239f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.515634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0ee3-8792-4055-9a71-67d0921239f5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.516128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0ee3-8792-4055-9a71-67d0921239f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.516566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14db0ee3-8792-4055-9a71-67d0921239f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.529994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0ee3-8792-4055-9a71-67d0921239f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.531960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14db0ee3-8792-4055-9a71-67d0921239f5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.551734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.552535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.552817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.553609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-14db0ee3-8792-4055-9a71-67d0921239f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:34.559169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:34.560050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:34.560956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:34.560956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:34.560956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:34.560956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:34.560956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 340/668] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:34.562067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6245c-3521-446c-8ec2-359cb85b5460 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.562355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6245c-3521-446c-8ec2-359cb85b5460 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.562656 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6245c-3521-446c-8ec2-359cb85b5460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.565339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.566367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:34.585832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:34.586774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:34.587698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:34.587698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:34.587698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:34.587698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:34.588400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 329/669] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:34.588968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.589589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ead6245c-3521-446c-8ec2-359cb85b5460 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:34.590812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ead6245c-3521-446c-8ec2-359cb85b5460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:34.602420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.640921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.679107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 341/670] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:34.686992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6245c-3521-446c-8ec2-359cb85b5460 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.742307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2788d1d-096d-4fa2-8545-dc06d0bc9958 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.780699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.781824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.782311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.782796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.783775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:34.784284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.784391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6245c-3521-446c-8ec2-359cb85b5460 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.786103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.800016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 330/671] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:34.801600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.821958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.822672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.823150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.823486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.824272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:34.824520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.825951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:34.842470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 342/672] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:34.842470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.843187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.914655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:34.921411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8dce6f-6156-4761-9a81-d1af748de7f3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.945946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01f1c7-4f4c-4f36-b631-6a14b4454994 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:34.958729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.959972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.960461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.960943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.971805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:34.980441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:34.981440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:34.982279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:34.983947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:34.984745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:34.985036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:34.989897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:34.990367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 331/673] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:34.992066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:34.993059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:34.994577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:35.010471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:35.011453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:35.012347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 343/674] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:35.013268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.085271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:35.104466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbab7f-7925-4580-82b4-c7bb3717192b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.129432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2457c6-1cc9-4a21-925e-bc7e8e4e3687 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.140314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.141463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.141898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.142308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.152764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.154441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:35.172334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:35.173428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:35.174317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:35.180976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.180976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.180976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.180976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.181318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:35.181318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.181318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.181901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 332/675] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:35.183156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.194900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 344/676] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:35.194900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.207114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:35.302802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0bc2e-f9fc-4fd3-ab73-1e6cddb7ef36 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.303207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbf497-dbc3-4f5c-90c5-6fc32ff1df05 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.333842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:35.340077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.340628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.340915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.341195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.341984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:35.342299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.343684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d91a4-46bc-49f8-9e77-09df6e7baea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.343797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.344340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d91a4-46bc-49f8-9e77-09df6e7baea0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.344623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d91a4-46bc-49f8-9e77-09df6e7baea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.344897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d91a4-46bc-49f8-9e77-09df6e7baea0 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.345729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d91a4-46bc-49f8-9e77-09df6e7baea0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:35.346027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d91a4-46bc-49f8-9e77-09df6e7baea0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.347553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d91a4-46bc-49f8-9e77-09df6e7baea0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.360889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 333/677] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:35.360889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.364927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 345/678] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:35.369622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12fc21-b820-4a56-92d8-08f5968ee6bf None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.369622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12fc21-b820-4a56-92d8-08f5968ee6bf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.369622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12fc21-b820-4a56-92d8-08f5968ee6bf None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.369622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 346/679] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:35.369622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12fc21-b820-4a56-92d8-08f5968ee6bf None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.448362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:35.472841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a12140-bf0c-4b8b-9a7b-ba13a9b6b04d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.475670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12fc21-b820-4a56-92d8-08f5968ee6bf None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.505768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8745aa9-b56f-4c0d-b9a9-83470d602f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.507197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745aa9-b56f-4c0d-b9a9-83470d602f4e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.507475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745aa9-b56f-4c0d-b9a9-83470d602f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.507755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8745aa9-b56f-4c0d-b9a9-83470d602f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.515103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.515948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.516409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.516869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.517691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=8751982010ae4b7eb6c855aea7540a23) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:35.518038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.519002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8745aa9-b56f-4c0d-b9a9-83470d602f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.519447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.520437 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8745aa9-b56f-4c0d-b9a9-83470d602f4e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.532772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 347/680] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/role_assignments?user.id=8751982010ae4b7eb6c855aea7540a23&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:35.532772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a8745aa9-b56f-4c0d-b9a9-83470d602f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:35.539404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:35.540345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:35.541322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:35.541322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:35.541322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:35.541322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:35.549620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 334/681] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:35.549620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373de6c-127e-4ffa-b9b0-c9f58e23722f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.549620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373de6c-127e-4ffa-b9b0-c9f58e23722f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.549620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373de6c-127e-4ffa-b9b0-c9f58e23722f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.577674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c373de6c-127e-4ffa-b9b0-c9f58e23722f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:35.578972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c373de6c-127e-4ffa-b9b0-c9f58e23722f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:35.625530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:35.690786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320790b2-d02a-4255-9624-e5049e5da1ef None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.707285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 335/682] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:35.708253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373de6c-127e-4ffa-b9b0-c9f58e23722f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.754792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.755517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.755800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.756075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.757494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=4225e82ea268483daa86078abb11c7f6) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:35.757811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.759669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.767212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 348/683] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/role_assignments?user.id=4225e82ea268483daa86078abb11c7f6&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:35.768164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.788729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:35.843446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373de6c-127e-4ffa-b9b0-c9f58e23722f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.887981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800863-5611-4503-b691-4ac58397058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.889105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800863-5611-4503-b691-4ac58397058e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.889527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800863-5611-4503-b691-4ac58397058e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.889814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25800863-5611-4503-b691-4ac58397058e None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.890583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800863-5611-4503-b691-4ac58397058e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:35.891149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800863-5611-4503-b691-4ac58397058e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:35.893406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25800863-5611-4503-b691-4ac58397058e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:35.911118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 336/684] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:35.917535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800863-5611-4503-b691-4ac58397058e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:35.926467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f503704-6db2-4698-bef3-3e13085b46dc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:35.943244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:35.971580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:35.972672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:35.972967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:35.973249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:35.989994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:36.000649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:36.001610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:36.002428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:36.004982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 349/685] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:36.008619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:36.073487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25800863-5611-4503-b691-4ac58397058e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:36.092822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:36.111930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:36.112745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.113033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.113311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.122983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:36.124524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:36.140469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:36.141414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:36.142318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 337/686] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:36.145998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed599f3f-67cd-434b-8dd9-3094a2168d9f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:36.147623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:36.198279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:36.199379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.199886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.200938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.201912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:36.202913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:36.204982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:36.216798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 350/687] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:36.222650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:36.308723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:36.310247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e7b0e-2716-4344-bdb3-f2c532329c75 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:36.363949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:36.364639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.364927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.365206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.366661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:36.370064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:36.370064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:36.388252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 338/688] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 19:59:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:36.394074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:36.433237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016577ff-3de7-47a7-9d76-7c6d12d10d6a None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:36.458906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:36.487092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:36.487894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.488181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.488460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.500192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:36.501646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:36.519027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:36.519913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:36.520846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:36.520846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:36.520846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:36.520846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:36.525333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 351/689] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:36.526544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:36.618702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b94b7-ce92-487d-9c1a-2d77fa2d7981 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:36.623961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:36.640519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe377fd9-de9f-47bf-908c-b61ef91ff534 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:36.679280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:36.679884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.680168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.680452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.681378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:36.681691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:36.683111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:36.696916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 352/690] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:36.697682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a99467-0c5b-4d8d-9a97-48a5f6cafe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:36.698415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99467-0c5b-4d8d-9a97-48a5f6cafe2d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.698705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99467-0c5b-4d8d-9a97-48a5f6cafe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.699026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99467-0c5b-4d8d-9a97-48a5f6cafe2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.702201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:36.824148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a99467-0c5b-4d8d-9a97-48a5f6cafe2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:36.825629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a99467-0c5b-4d8d-9a97-48a5f6cafe2d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:36.878634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bfe5bb-a3b5-44cb-baea-4b1a89ca83a6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:36.886356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:36.916109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41971f-0531-4758-a572-9e337f0e9cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:36.916908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41971f-0531-4758-a572-9e337f0e9cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.917197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41971f-0531-4758-a572-9e337f0e9cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.917471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41971f-0531-4758-a572-9e337f0e9cc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.927284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41971f-0531-4758-a572-9e337f0e9cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:36.928763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae41971f-0531-4758-a572-9e337f0e9cc5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ae41971f-0531-4758-a572-9e337f0e9cc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:36.950995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:36.952017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:36.952951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:36.955759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 353/691] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 19:59:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:36.957246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61139b-2751-4fc0-a1ae-a718d714a6a4 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.957692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61139b-2751-4fc0-a1ae-a718d714a6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.958126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61139b-2751-4fc0-a1ae-a718d714a6a4 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:36.965103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 354/692] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:36.965103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61139b-2751-4fc0-a1ae-a718d714a6a4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:36.979194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:36.986137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 339/693] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:59:36.986137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439ab5-fee9-4910-b8df-a6ae419c0987 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:36.986137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439ab5-fee9-4910-b8df-a6ae419c0987 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:36.986137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76439ab5-fee9-4910-b8df-a6ae419c0987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.002338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-76439ab5-fee9-4910-b8df-a6ae419c0987 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:37.003567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-76439ab5-fee9-4910-b8df-a6ae419c0987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:37.078114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61139b-2751-4fc0-a1ae-a718d714a6a4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.096995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 340/694] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:37.096995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76439ab5-fee9-4910-b8df-a6ae419c0987 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.136005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.137646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.138162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.138958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.140336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:37.140662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.142085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.162325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 355/695] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 19:59:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:37.163336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.178068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:37.217933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76439ab5-fee9-4910-b8df-a6ae419c0987 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.232050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:37.258485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.259399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.259678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.260063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.273104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac8fa8f-552f-43e8-bd7f-f4e56912a167 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.273300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.274229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:37.294780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:37.295730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:37.296607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:37.296607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:37.296607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:37.296607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:37.300829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 341/696] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:37.301666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.310861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.310861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.310861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.310861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.324472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.326380 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:37.349912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:37.350902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:37.351797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:37.351797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:37.351797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:37.351797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:37.355014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 356/697] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:37.355834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.421576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de67c01-5536-43ac-b2cf-38680eb2e727 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.444277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:37.467298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.468648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.469087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.469514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.488420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23ad41-fe48-4447-9215-e04a8e5e74d8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.511813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:37.534459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.535397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.535975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.536698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.537866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:37.538338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.540041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.543436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.544696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.559478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 357/698] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:37.560562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.674045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 342/699] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:37.675089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.687889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace1054-a33b-41c5-a421-1ad79468c06f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.695609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:37.729832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.730423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.730770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.731015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.731743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:37.732056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.733492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.750750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 358/700] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:37.750750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.796756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:37.799174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d801440-700a-42c3-af82-1c5faba0cf5a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.835782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.836744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.837130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.837506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.844977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.846586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:37.861757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:37.862698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:37.863603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:37.868309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 343/701] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:37.868799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33240e77-de37-4d64-a6bd-d1bea78eb1af None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:37.869269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.907621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:37.908839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:37.909312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:37.909766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:37.921144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:37.923164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:37.946861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:37.947816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:37.948689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:37.948689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:37.948689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:37.948689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:37.950996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 359/702] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:37.951986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:37.957210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:37.981397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8747165-a22d-495b-8047-68758d8fe04a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.017732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.018510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.018887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.019244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.020025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.021526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.055145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 344/703] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 19:59:37 2022] POST /identity/v3/users => generated 254 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:38.055145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.076169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:38.095296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105dd13-f765-4e98-8aa9-31618503cb9d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.167054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.168209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.168695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.169203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.170190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:38.170799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.172482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.187103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 360/704] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:38.195091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.222227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08a358-c468-4d40-8bc5-47cfda591f09 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.271531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a8895-aba0-46de-b2c2-3ed2a440b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.272181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a8895-aba0-46de-b2c2-3ed2a440b96d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.272462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a8895-aba0-46de-b2c2-3ed2a440b96d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.272736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a8895-aba0-46de-b2c2-3ed2a440b96d None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.273755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a8895-aba0-46de-b2c2-3ed2a440b96d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:38.273969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a8895-aba0-46de-b2c2-3ed2a440b96d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.275682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a8895-aba0-46de-b2c2-3ed2a440b96d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.277566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:38.295016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 345/705] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:38.296814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b47ef-8b9a-4589-9651-fd29f27f955b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.297316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b47ef-8b9a-4589-9651-fd29f27f955b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.297794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b47ef-8b9a-4589-9651-fd29f27f955b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.299679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 346/706] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:38.300674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b47ef-8b9a-4589-9651-fd29f27f955b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.347032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755106b8-f8b6-4be7-95d1-a650e4f88c96 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.390084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9637f-f61c-406b-9352-6a2a72ca4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.391046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9637f-f61c-406b-9352-6a2a72ca4c08 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.391329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9637f-f61c-406b-9352-6a2a72ca4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.391601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9637f-f61c-406b-9352-6a2a72ca4c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.392431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9637f-f61c-406b-9352-6a2a72ca4c08 None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=b80af2efebf440959ceb238bd27cf7f2) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:38.392737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9637f-f61c-406b-9352-6a2a72ca4c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.394162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9637f-f61c-406b-9352-6a2a72ca4c08 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.402189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 361/707] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/role_assignments?user.id=b80af2efebf440959ceb238bd27cf7f2&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:38.403690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c63ff-c093-420a-bdcb-67c878567286 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.403980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c63ff-c093-420a-bdcb-67c878567286 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.404257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c63ff-c093-420a-bdcb-67c878567286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.426584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d04c63ff-c093-420a-bdcb-67c878567286 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:38.427944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d04c63ff-c093-420a-bdcb-67c878567286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:38.429757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b47ef-8b9a-4589-9651-fd29f27f955b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.447287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:38.472229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c58eb-f312-48ff-8193-c138469b49f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.473155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c58eb-f312-48ff-8193-c138469b49f0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.473436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c58eb-f312-48ff-8193-c138469b49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.473706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c58eb-f312-48ff-8193-c138469b49f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.481875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c58eb-f312-48ff-8193-c138469b49f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.483476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c58eb-f312-48ff-8193-c138469b49f0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-dd2c58eb-f312-48ff-8193-c138469b49f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:38.500002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:38.500990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:38.501878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 347/708] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:38.507810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5138-be67-49dd-8fbd-c88e83894ddd None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.508171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5138-be67-49dd-8fbd-c88e83894ddd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.508453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c5138-be67-49dd-8fbd-c88e83894ddd None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.511159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 348/709] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:38.512455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c5138-be67-49dd-8fbd-c88e83894ddd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.544182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 362/710] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:38.546157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0a13-5ca0-4303-9e05-294ea7573b5b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.546451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0a13-5ca0-4303-9e05-294ea7573b5b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.546731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0a13-5ca0-4303-9e05-294ea7573b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.567853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fd6a0a13-5ca0-4303-9e05-294ea7573b5b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:38.569211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fd6a0a13-5ca0-4303-9e05-294ea7573b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:38.603503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:38.666262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 363/711] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:38.667180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a0a13-5ca0-4303-9e05-294ea7573b5b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.668501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c5138-be67-49dd-8fbd-c88e83894ddd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.712306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.712974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.713256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.713530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.714316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:38.714627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.716089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.731753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 349/712] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:38.732320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.763175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:38.795347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a0a13-5ca0-4303-9e05-294ea7573b5b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.843168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.844348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.844806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.845253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] PATH_INFO: `/v3/services/network` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.846182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.847912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.863161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab29d47-f454-47e2-bc41-c7df2753a6e9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:38.864091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:38.865066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:38.866046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:38.868620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 364/713] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:38.869636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.879512 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:38.902804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:38.903625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:38.904012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:38.904392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:38.905152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:38.906760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:38.921641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:38.922875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:38.923843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:38.929612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 350/714] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:38.930501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:38.988517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25929846-b48c-4aea-afb7-bca5a391700c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:39.027443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:39.028584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:39.029172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:39.029627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:39.030632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=e8a59979309a45f98c0b4fb27af83c6e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:39.031144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:39.033040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:39.038190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034764d3-c517-4111-af64-c0ae3342c98c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:39.040384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 365/715] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/role_assignments?user.id=e8a59979309a45f98c0b4fb27af83c6e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:39.041426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:39.044486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:39.077777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:39.078506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:39.078968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:39.079264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:39.080400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] RBAC: Adding query filter params (name=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:39.080400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:39.081913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:39.087764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 351/716] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 19:59:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:39.100266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:39.173706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ba3c1-4fcc-4d3c-a41d-eaa46680d23c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:39.179212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:39.211883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:39.212560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:39.212843 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:39.213128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:39.213832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:39.214137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:39.215631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:39.221123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 366/717] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 19:59:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:39.236113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:39.269706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c42d66-e3ee-4c34-8aa1-884c64a895ba None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:39.316927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:39.328705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4277d-480e-4cf4-b2f5-9da570fab0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:39.329327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4277d-480e-4cf4-b2f5-9da570fab0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:39.329620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4277d-480e-4cf4-b2f5-9da570fab0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:39.329905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4277d-480e-4cf4-b2f5-9da570fab0b7 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:39.330626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4277d-480e-4cf4-b2f5-9da570fab0b7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:39.331097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4277d-480e-4cf4-b2f5-9da570fab0b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:39.332479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4277d-480e-4cf4-b2f5-9da570fab0b7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:39.348033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 352/718] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 19:59:39 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:39.359240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6af120-f285-4bdc-a5d1-445e4b63af39 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:39.414706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fef85-6467-4f29-ab69-f53edcd3a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:39.415776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fef85-6467-4f29-ab69-f53edcd3a6ce None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:39.416261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fef85-6467-4f29-ab69-f53edcd3a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:39.416746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fef85-6467-4f29-ab69-f53edcd3a6ce None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:39.417703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fef85-6467-4f29-ab69-f53edcd3a6ce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:39.418222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fef85-6467-4f29-ab69-f53edcd3a6ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:39.419816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fef85-6467-4f29-ab69-f53edcd3a6ce None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:39.432307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 367/719] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 19:59:39 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:40.795032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614407b4-63d3-41dd-b2fa-2c283c8689ea None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:40.795577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614407b4-63d3-41dd-b2fa-2c283c8689ea None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:40.795849 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614407b4-63d3-41dd-b2fa-2c283c8689ea None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:40.797386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 353/720] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:40.802484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a173-df0f-4e89-8019-44711dd803a3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:40.802965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a173-df0f-4e89-8019-44711dd803a3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:40.803654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9a173-df0f-4e89-8019-44711dd803a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:40.827805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-59a9a173-df0f-4e89-8019-44711dd803a3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:40.829025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-59a9a173-df0f-4e89-8019-44711dd803a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:40.924627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 368/721] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:40.960057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614407b4-63d3-41dd-b2fa-2c283c8689ea None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:41.114681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614407b4-63d3-41dd-b2fa-2c283c8689ea None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:41.124799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:41.163055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:41.163758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.164040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.164310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.183840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:41.189859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844510a-ab80-43dd-b798-f73c4efb8d33 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.190150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844510a-ab80-43dd-b798-f73c4efb8d33 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.190432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844510a-ab80-43dd-b798-f73c4efb8d33 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.191839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 369/722] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:41.196136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:41.198201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:41.200224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 354/723] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:41.203880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848309d6-348f-4b70-8456-a106829ae1e7 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.203880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848309d6-348f-4b70-8456-a106829ae1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.203880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848309d6-348f-4b70-8456-a106829ae1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.210394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:41.248017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-848309d6-348f-4b70-8456-a106829ae1e7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:41.249596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-848309d6-348f-4b70-8456-a106829ae1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:41.358669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f3245-377b-45c0-a404-c296f276e774 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:41.359036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:41.381456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 370/724] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:59:41.414996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:41.415789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.416073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.416346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.417119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:41.417424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:41.418818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:41.435720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 355/725] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:41.436811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848309d6-348f-4b70-8456-a106829ae1e7 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:41.447794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:41.480737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:41.566117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229dd8df-3732-444f-bd13-0d492a872bc2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:41.605413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:41.606347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.606634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.606933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.619124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:41.628748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:41.629914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:41.631491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:41.638861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 356/726] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:41.639693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:41.652617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848309d6-348f-4b70-8456-a106829ae1e7 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:41.735395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:41.736493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.736923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.737344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.738984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:41.752586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accca30a-0267-4577-8e25-505e963293f2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:41.766272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:41.768059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:41.797415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:41.798349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:41.799243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:41.799243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:41.799243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:41.799243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:41.799243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 371/727] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:41.800556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5001-5a0a-4e74-9aba-a0323b3d3a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:41.801770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5001-5a0a-4e74-9aba-a0323b3d3a65 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.802217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5001-5a0a-4e74-9aba-a0323b3d3a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.802654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5001-5a0a-4e74-9aba-a0323b3d3a65 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.804115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5001-5a0a-4e74-9aba-a0323b3d3a65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:41.804610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5001-5a0a-4e74-9aba-a0323b3d3a65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:41.805135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:41.806632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5001-5a0a-4e74-9aba-a0323b3d3a65 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:41.825017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 357/728] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:41.826855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d629c7-98cb-48f0-9150-0377a9ddfd92 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.827357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d629c7-98cb-48f0-9150-0377a9ddfd92 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.827838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d629c7-98cb-48f0-9150-0377a9ddfd92 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.833208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 358/729] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:41.834206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d629c7-98cb-48f0-9150-0377a9ddfd92 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:41.868864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:41.940650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e252b-b117-4ad3-a052-1468401e1141 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:41.960751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d629c7-98cb-48f0-9150-0377a9ddfd92 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:41.987129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2981270-e41e-4be0-b640-dee5f349b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:41.987724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981270-e41e-4be0-b640-dee5f349b113 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:41.988004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981270-e41e-4be0-b640-dee5f349b113 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:41.988328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2981270-e41e-4be0-b640-dee5f349b113 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:41.989058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981270-e41e-4be0-b640-dee5f349b113 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:41.989400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981270-e41e-4be0-b640-dee5f349b113 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:41.991873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2981270-e41e-4be0-b640-dee5f349b113 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.011000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 372/730] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:42.012675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d995-1af1-4def-97d1-40306d4a5c0e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.012972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d995-1af1-4def-97d1-40306d4a5c0e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.013253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6d995-1af1-4def-97d1-40306d4a5c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.021707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.022507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.022796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.023095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.036010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b2e6d995-1af1-4def-97d1-40306d4a5c0e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:42.037023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b2e6d995-1af1-4def-97d1-40306d4a5c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:42.038515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.040424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:42.059934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:42.060834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:42.061698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:42.061698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:42.061698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:42.061698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:42.069193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 359/731] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:42.070862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.074408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.123123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 373/732] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:42.124842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6d995-1af1-4def-97d1-40306d4a5c0e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.169058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.190372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428ead9-69dd-4c81-b3b8-f34366ca544c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.229721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49a60-f9b8-40ae-851d-07b8b17e2781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.230723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49a60-f9b8-40ae-851d-07b8b17e2781 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.231058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49a60-f9b8-40ae-851d-07b8b17e2781 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.231337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49a60-f9b8-40ae-851d-07b8b17e2781 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.239912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49a60-f9b8-40ae-851d-07b8b17e2781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.241793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6d995-1af1-4def-97d1-40306d4a5c0e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.241905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49a60-f9b8-40ae-851d-07b8b17e2781 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-7fb49a60-f9b8-40ae-851d-07b8b17e2781 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:42.257280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:42.258246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:42.259196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 360/733] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:42.259773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bde63-1f35-4529-8c39-c963847206b4 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.260443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bde63-1f35-4529-8c39-c963847206b4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.260443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857bde63-1f35-4529-8c39-c963847206b4 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.261613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 361/734] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:42.266112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bde63-1f35-4529-8c39-c963847206b4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.284113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.284785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.285067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.285348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.286069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:42.286373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.288320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.299483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 374/735] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:42.300414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.328941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.369011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857bde63-1f35-4529-8c39-c963847206b4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.389650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.399191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb721a1-b7dc-444a-939f-d8e90eff28f5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.402356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a163ac4-d8b3-4b1d-8e55-3f6c47bf9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.403177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a163ac4-d8b3-4b1d-8e55-3f6c47bf9631 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.403458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a163ac4-d8b3-4b1d-8e55-3f6c47bf9631 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.403732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a163ac4-d8b3-4b1d-8e55-3f6c47bf9631 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.414485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a163ac4-d8b3-4b1d-8e55-3f6c47bf9631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-3a163ac4-d8b3-4b1d-8e55-3f6c47bf9631 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:42.422342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:42.423436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:42.424249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 362/736] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:42.425420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3930-76a6-4285-b066-640d9e366342 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.425713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3930-76a6-4285-b066-640d9e366342 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.425993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a3930-76a6-4285-b066-640d9e366342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.437246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9fd66-d124-4c16-8c7a-e3e0e9bf874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.437912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9fd66-d124-4c16-8c7a-e3e0e9bf874a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.438193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9fd66-d124-4c16-8c7a-e3e0e9bf874a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.438468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9fd66-d124-4c16-8c7a-e3e0e9bf874a None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.439329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9fd66-d124-4c16-8c7a-e3e0e9bf874a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:42.439636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9fd66-d124-4c16-8c7a-e3e0e9bf874a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.441058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9fd66-d124-4c16-8c7a-e3e0e9bf874a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.442587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2f9a3930-76a6-4285-b066-640d9e366342 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:42.443815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2f9a3930-76a6-4285-b066-640d9e366342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:42.460525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 375/737] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:42.460525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647495a-f57b-44a2-9a1c-9c76d11fd63a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.460525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647495a-f57b-44a2-9a1c-9c76d11fd63a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.460525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647495a-f57b-44a2-9a1c-9c76d11fd63a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.460525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 376/738] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:42.460525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647495a-f57b-44a2-9a1c-9c76d11fd63a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.513504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 363/739] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:42.514257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3930-76a6-4285-b066-640d9e366342 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.563946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647495a-f57b-44a2-9a1c-9c76d11fd63a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.596666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.602253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.603085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.603370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.603642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.610823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.612289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:42.626718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:42.627755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:42.628684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 377/740] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:42.629292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.641490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.648486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a3930-76a6-4285-b066-640d9e366342 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.683210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c50b6-cf86-4e8e-9de0-0849e1d4f964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.683958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c50b6-cf86-4e8e-9de0-0849e1d4f964 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.684249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c50b6-cf86-4e8e-9de0-0849e1d4f964 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.684530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c50b6-cf86-4e8e-9de0-0849e1d4f964 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.685277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c50b6-cf86-4e8e-9de0-0849e1d4f964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:42.685593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c50b6-cf86-4e8e-9de0-0849e1d4f964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.686975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c50b6-cf86-4e8e-9de0-0849e1d4f964 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.695131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 364/741] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:42.696288 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88306a-daba-4ded-8276-165e02d127a5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.696579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88306a-daba-4ded-8276-165e02d127a5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.696861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88306a-daba-4ded-8276-165e02d127a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.712821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8e88306a-daba-4ded-8276-165e02d127a5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:42.713993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8e88306a-daba-4ded-8276-165e02d127a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:42.734942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e3baf-eb70-422f-8a0b-18afd5820f76 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.767865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.768446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.768727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.768997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.780017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 365/742] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:59:42.780654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88306a-daba-4ded-8276-165e02d127a5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.827106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.838323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.840288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.852227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:42.880264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88306a-daba-4ded-8276-165e02d127a5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:42.914236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:42.914928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:42.915216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:42.915495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:42.916218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:42.917598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:42.933059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 366/743] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 19:59:42 2022] POST /identity/v3/services => generated 240 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:42.934143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:42.946928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 378/744] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:59:42.948633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.058030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.064128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf00da-25e6-463f-92de-5d641b5bbe70 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.065139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281cf0a-78e8-4c14-855d-e54dafa62873 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.078737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.105645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.106459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.106742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.107046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.109052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.110258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.110258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.110418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.111191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:43.111504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.113410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.120694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.122428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.132033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 367/745] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:43.137546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:43.141083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:43.141982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:43.143308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:43.143308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:43.143308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:43.143308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:43.143308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 379/746] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:43.143609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.248210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f1837-97ca-4ce7-b3ea-24de47f542b7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.248630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f1836-917d-47bf-bc7e-73be67ea95bc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.285251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.286177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.286539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.286924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.289623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.290185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.290477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.291071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.291526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.292913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.299325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.300859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.318959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 368/747] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 19:59:43 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:43.318959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:43.319635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:43.320556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:43.322015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:43.322015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:43.322015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:43.322015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:43.322015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 380/748] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:43.322015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.343640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.350789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.450085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cee00-c10b-4298-a304-5a01ab82abf9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.480031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b7178-83b5-4580-bf14-295e8dc46516 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.500837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.501985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.502371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.502975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.504164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:43.504585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.506696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.523778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 381/749] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:43.524562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.526217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.526906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.527207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.527788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.624103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.624103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.630386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.644213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.660553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4d4c9-26ce-43d6-8924-f62077030d8e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.705588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.706604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.707065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.707434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.708420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:43.708830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.710442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.729052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 382/750] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:43.730182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.752405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 369/751] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:59:43.753343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.843601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad02c8-2bf5-46c7-a2a7-46f8911eed1e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.857885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4ad8-fa48-4477-9c28-1de507acae41 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:43.873009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.882522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.883764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.884405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.884681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.886930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:43.893335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.895238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.895444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:43.896324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:43.896840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:43.897193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:43.905078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:43.906617 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:43.912949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:43.913914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:43.914828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:43.921858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 383/752] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:43.922472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:43.923350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:43.924195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:43.925489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:43.926927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 370/753] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:43.928563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.053364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f30cf-ecc9-4921-804a-85777537f5e9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.095230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.096438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.096922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.097420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.110222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.112239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:44.132256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:44.133265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:44.134139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:44.134139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:44.134139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:44.134139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:44.136586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 384/754] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:44.137732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.198381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:44.202182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4fe31-416b-488f-a13a-e6e7c2312650 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.247079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.248817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.249311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.249786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.250832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:44.251785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.253957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.270410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c21b7b6-581b-4a9d-96c2-9d22078f19d9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.282263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 371/755] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 19:59:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:44.283492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.326260 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:44.334823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.339235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.339608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.340416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.341279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:44.341657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.343659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.362981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 385/756] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:44.364005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.407553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fac922-0cb2-4fcc-99ff-af47512c3839 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.452265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.453104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.453418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.453759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.454633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:44.455037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.456944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.475493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 372/757] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:44.476640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.488956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496553-b0d9-4245-9586-dc26694f4d66 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.499170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:44.536459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.538479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.538771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.539076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.555702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.557706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.583026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:44.585557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:44.586421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:44.587673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:44.587673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:44.587673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:44.587673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:44.590909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 386/758] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:44.592895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.601092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d76e7-ec11-4c4e-95d5-98f1fb3417a6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.646382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.647115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.647666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.647953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.648798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=29b2238abdfd4140a850d53943fb931e) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:44.649121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.651298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.663013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 373/759] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/role_assignments?user.id=29b2238abdfd4140a850d53943fb931e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:44.664348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.757277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f697c0a-6249-4152-8c71-1552616a198d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.826642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.827877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.828682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.829472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.844721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.850069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:44.873737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:44.874689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:44.875622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:44.883109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a55a3-a9dc-4c72-b0ef-f06a6728451e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:44.891016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 387/760] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:44.897105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.921263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:44.927661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:44.929152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:44.929632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:44.930102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:44.931055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:44.931560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:44.933154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:44.947036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 374/761] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:44.964385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:44.998868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:45.020211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066039c1-ae5e-45af-9c85-c2fcb9a3526f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:45.061294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:45.062031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.062319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.062635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.063647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:45.063965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:45.065414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:45.079377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 388/762] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:45.085289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:45.144598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d18e45-ee6e-4bdf-aa8c-98f2e98fd710 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:45.171814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:45.197264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db86b9d-5ec5-495c-8f1a-cb51ae357554 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:45.210335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a424c1-5024-451e-a62e-8ac6e74ad0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:45.211146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a424c1-5024-451e-a62e-8ac6e74ad0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.211427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a424c1-5024-451e-a62e-8ac6e74ad0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.211702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a424c1-5024-451e-a62e-8ac6e74ad0f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.221723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a424c1-5024-451e-a62e-8ac6e74ad0f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:45.223323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a424c1-5024-451e-a62e-8ac6e74ad0f8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:45.237284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b056b9e0-4646-470f-93de-35be8a338ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-74a424c1-5024-451e-a62e-8ac6e74ad0f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:45.237976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:45.238919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:45.240296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 375/763] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:45.241311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a20b9-6139-43b7-80ab-e618f0b3f281 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.241608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a20b9-6139-43b7-80ab-e618f0b3f281 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.241863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a20b9-6139-43b7-80ab-e618f0b3f281 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.242279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056b9e0-4646-470f-93de-35be8a338ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.242757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056b9e0-4646-470f-93de-35be8a338ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.243252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b056b9e0-4646-470f-93de-35be8a338ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.244423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056b9e0-4646-470f-93de-35be8a338ae8 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=b80af2efebf440959ceb238bd27cf7f2) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:45.244947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056b9e0-4646-470f-93de-35be8a338ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:45.246634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b056b9e0-4646-470f-93de-35be8a338ae8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:45.248000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 376/764] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:45.248766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a20b9-6139-43b7-80ab-e618f0b3f281 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:45.258985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 389/765] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:45 2022] GET /identity/v3/role_assignments?user.id=b80af2efebf440959ceb238bd27cf7f2&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:45.260881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eefd83-9762-4934-9baf-d78c5ae2e986 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.261524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eefd83-9762-4934-9baf-d78c5ae2e986 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.262009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eefd83-9762-4934-9baf-d78c5ae2e986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.293574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d5eefd83-9762-4934-9baf-d78c5ae2e986 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:45.295387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d5eefd83-9762-4934-9baf-d78c5ae2e986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:45.346648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:45.396888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a20b9-6139-43b7-80ab-e618f0b3f281 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:45.450727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 390/766] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:45.464724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:45.465438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.465721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.466064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.466938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:45.467254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:45.468852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:45.473332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eefd83-9762-4934-9baf-d78c5ae2e986 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:45.501707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 377/767] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:45.508456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:45.579674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:45.612811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eefd83-9762-4934-9baf-d78c5ae2e986 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:45.628078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77d2ec-ce30-40d4-9712-7a3395d48dcd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:45.650244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bc574-f121-4c19-aa50-bb8a69e462d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:45.651395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc574-f121-4c19-aa50-bb8a69e462d2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.651904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc574-f121-4c19-aa50-bb8a69e462d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.652392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bc574-f121-4c19-aa50-bb8a69e462d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.653263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc574-f121-4c19-aa50-bb8a69e462d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:45.662809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bc574-f121-4c19-aa50-bb8a69e462d2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:45.668286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:45.669223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.669510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.669768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/e8a59979309a45f98c0b4fb27af83c6e/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.671771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=e8a59979309a45f98c0b4fb27af83c6e, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:45.678873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:45.679239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-517bc574-f121-4c19-aa50-bb8a69e462d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:45.684044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:45.685470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:45.686346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 391/768] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:45 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:45.691810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e545-fb7b-4f25-af2f-be746ac48d91 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.692102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e545-fb7b-4f25-af2f-be746ac48d91 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.692379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788e545-fb7b-4f25-af2f-be746ac48d91 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.693842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 378/769] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:45 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/e8a59979309a45f98c0b4fb27af83c6e/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:45.698938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 392/770] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:45.700286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:45.700414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b7b7e-f5f3-4295-88a8-346ebac746c2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.700414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b7b7e-f5f3-4295-88a8-346ebac746c2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.700414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b7b7e-f5f3-4295-88a8-346ebac746c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.734557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-963b7b7e-f5f3-4295-88a8-346ebac746c2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:45.735948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-963b7b7e-f5f3-4295-88a8-346ebac746c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:45.892001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 393/771] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:59:45.900817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960f168-6516-40e3-9ba6-a409721fcb7b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:45.936904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b7b7e-f5f3-4295-88a8-346ebac746c2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:45.945827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:45.946501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:45.946786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:45.947095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:45.947804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] RBAC: Adding query filter params (name=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:45.948473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:45.950163 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:45.956491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 379/772] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 19:59:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:45.963430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:46.015815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:46.043256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:46.062893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b7b7e-f5f3-4295-88a8-346ebac746c2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:46.091482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9a28a-eeb8-455b-b4c4-4f34a1f96226 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:46.112170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:46.112997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:46.113282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:46.113559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:46.114770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:46.116491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:46.129115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:46.129783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:46.130068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:46.130344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:46.131645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] RBAC: Adding query filter params (type=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:46.131933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:46.133045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:46.133937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:46.134946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:46.135758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:46.135827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 394/773] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 26 19:59:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:46.138663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 380/774] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 19:59:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:46.142547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:46.145837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:46.256425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae599-b3dd-4c09-9080-531681b35d83 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:46.292260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:46.292955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:46.293246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:46.293630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:46.294347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:46.294653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:46.296084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:46.299182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:46.301316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 395/775] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 19:59:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:46.307234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:46.368686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3e889-c5ab-4e75-8b91-7aa9e8dc4b61 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:46.422275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:46.451262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:46.451951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:46.452241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:46.452522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:46.453689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] RBAC: Adding query filter params (interface=public, service_id=0e7c7519088248ffbe936a436f92cfae, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:46.454011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:46.455831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:46.474555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 381/776] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 19:59:46 2022] GET /identity/v3/endpoints?service_id=0e7c7519088248ffbe936a436f92cfae&interface=public®ion_id=RegionOne => generated 194 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:46.486597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:46.515613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d115d23-90aa-450e-a3d8-3d1084ff71ba None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:46.552433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:46.553600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:46.553888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:46.554169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:46.555034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:46.555345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:46.556851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:46.562195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 396/777] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 19:59:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:46.567668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:46.683829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:46.716233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abfa45-3981-43df-b973-e7c9dba935cc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:46.744947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c7c02-6a9a-4aff-82be-5312a00a325c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:46.780710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:46.781380 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:46.781666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:46.781940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:46.782730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] RBAC: Adding query filter params (interface=public, service_id=81b88d12e79449f58f29452ffe607e6e, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:46.783068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:46.784512 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3317e2-46e8-40c8-ae61-d66cb58ebc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:46.784713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:46.785199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3317e2-46e8-40c8-ae61-d66cb58ebc61 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:46.785485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3317e2-46e8-40c8-ae61-d66cb58ebc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:46.785762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3317e2-46e8-40c8-ae61-d66cb58ebc61 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:46.786568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3317e2-46e8-40c8-ae61-d66cb58ebc61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:46.788522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3317e2-46e8-40c8-ae61-d66cb58ebc61 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:46.793538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 397/778] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 19:59:46 2022] GET /identity/v3/endpoints?service_id=81b88d12e79449f58f29452ffe607e6e&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:46.794168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 382/779] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 19:59:46 2022] GET /identity/v3/services => generated 772 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:46.799525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:47.039748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991aa90a-4706-4375-ae1c-f618d31f7478 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:47.063843 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:47.076426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd518-f290-4ce0-ae83-2fef82fb4817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:47.077318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd518-f290-4ce0-ae83-2fef82fb4817 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:47.077670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd518-f290-4ce0-ae83-2fef82fb4817 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:47.078176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd518-f290-4ce0-ae83-2fef82fb4817 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:47.078897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd518-f290-4ce0-ae83-2fef82fb4817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:47.080298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd518-f290-4ce0-ae83-2fef82fb4817 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:47.087032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 398/780] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 19:59:46 2022] GET /identity/v3/services => generated 772 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:47.398085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70fb3-8637-49d2-9acf-472fa404d8a1 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:47.398085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70fb3-8637-49d2-9acf-472fa404d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:47.398085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70fb3-8637-49d2-9acf-472fa404d8a1 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:47.399475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 383/781] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:47.403150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5ac0-d00e-4a2f-9d4c-c59cc69e4db0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:47.403441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5ac0-d00e-4a2f-9d4c-c59cc69e4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:47.403719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5ac0-d00e-4a2f-9d4c-c59cc69e4db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:47.426944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c6de5ac0-d00e-4a2f-9d4c-c59cc69e4db0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:47.428176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c6de5ac0-d00e-4a2f-9d4c-c59cc69e4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:47.513801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 399/782] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:47.536962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70fb3-8637-49d2-9acf-472fa404d8a1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:47.624227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:47.691685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70fb3-8637-49d2-9acf-472fa404d8a1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:47.744193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:47.745007 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:47.745297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:47.745578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:47.765721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:47.773712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:47.774630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:47.775497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 384/783] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:47.780993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de5ac0-d00e-4a2f-9d4c-c59cc69e4db0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:47.914820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de5ac0-d00e-4a2f-9d4c-c59cc69e4db0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:47.932066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:47.951205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:47.951791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:47.952070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:47.952342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:47.953091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:47.953389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:47.954746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:47.964292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 400/784] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:47.970209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.122549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69422c35-2efa-4a45-9bd9-f33cb86667ee None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:48.140996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:48.169967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecb6258-20af-4d87-ab58-8e7842c4249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:48.170778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6258-20af-4d87-ab58-8e7842c4249d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.171088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6258-20af-4d87-ab58-8e7842c4249d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.171367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb6258-20af-4d87-ab58-8e7842c4249d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.188267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb6258-20af-4d87-ab58-8e7842c4249d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:48.189720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecb6258-20af-4d87-ab58-8e7842c4249d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9ecb6258-20af-4d87-ab58-8e7842c4249d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:48.216300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:48.217176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:48.218037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:48.218037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:48.218037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:48.218037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:48.218037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 385/785] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:48.224367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.260554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82964d-3d8e-4f4e-b262-58ad80d7edea None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.260890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82964d-3d8e-4f4e-b262-58ad80d7edea None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.261117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b82964d-3d8e-4f4e-b262-58ad80d7edea None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.263775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 386/786] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:48.271891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1673de-a36b-460e-af89-5f0b208b7b76 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.272238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1673de-a36b-460e-af89-5f0b208b7b76 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.272460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1673de-a36b-460e-af89-5f0b208b7b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.304661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2f1673de-a36b-460e-af89-5f0b208b7b76 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:48.305890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2f1673de-a36b-460e-af89-5f0b208b7b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:48.393756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219642ab-5aee-4e27-8922-76037d5d66c5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:48.435947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 387/787] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:59:48.457522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:48.458233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.458518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.458883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.459618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:48.459926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:48.461306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:48.477655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 401/788] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:48.482944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.483579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc62da-6a98-4d2b-bc4b-ac5a559adcc5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.483874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc62da-6a98-4d2b-bc4b-ac5a559adcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.484156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdc62da-6a98-4d2b-bc4b-ac5a559adcc5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.485762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 388/789] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:48.490938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc62da-6a98-4d2b-bc4b-ac5a559adcc5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.528990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:48.593698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:48.596754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854e221-660f-451e-8278-b6d44582c5bc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:48.602354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdc62da-6a98-4d2b-bc4b-ac5a559adcc5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:48.636938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:48.638877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc366-c203-4c01-bcd0-00e507635f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:48.639032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.639032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.639032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.639278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc366-c203-4c01-bcd0-00e507635f91 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.639278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc366-c203-4c01-bcd0-00e507635f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.639278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc366-c203-4c01-bcd0-00e507635f91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.646253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:48.648499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:48.651254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cc366-c203-4c01-bcd0-00e507635f91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-cb6cc366-c203-4c01-bcd0-00e507635f91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:48.659258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:48.660359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:48.661189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:48.664454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 389/790] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:48.665285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:48.666194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:48.667169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:48.668561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6e54-bb9c-4b65-bcd4-f8829734fb6e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.669045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6e54-bb9c-4b65-bcd4-f8829734fb6e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.669499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc6e54-bb9c-4b65-bcd4-f8829734fb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.675306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 402/791] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 19:59:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:48.675306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.691443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4bfc6e54-bb9c-4b65-bcd4-f8829734fb6e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:48.692902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4bfc6e54-bb9c-4b65-bcd4-f8829734fb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:48.771015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 390/792] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:48.772676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc6e54-bb9c-4b65-bcd4-f8829734fb6e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.776782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:48.781289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7996ce-e5ae-41bc-92da-ec7555d480c1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:48.818061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:48.818899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.819426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.819706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.820458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:48.820764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:48.822131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:48.836255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 403/793] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:48.837261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.874621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:48.892702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc6e54-bb9c-4b65-bcd4-f8829734fb6e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:48.937705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:48.938628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.938939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.939227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:48.940329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:48.940646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:48.942806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:48.951509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e9ebf-9e99-42aa-8221-b33f2e81aeb4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:48.967212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 391/794] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 19:59:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:48.968291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:48.996476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:48.997814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:48.998102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:48.998381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.015335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:49.024588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:49.025504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:49.026326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:49.033667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 404/795] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:49.034794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.058234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.105525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffabcd9-ff96-4439-b44c-58a11c297a82 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.142751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754967c-3ba0-4121-a94e-d249eda4cfb0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.150048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.150870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.151170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.151449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.165291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.167193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.169333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.183347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218791-a574-4506-aa12-717801369d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.184573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218791-a574-4506-aa12-717801369d51 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.185341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218791-a574-4506-aa12-717801369d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.185880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01218791-a574-4506-aa12-717801369d51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:49.189925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:49.190809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:49.191737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:49.191737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:49.191737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:49.191737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:49.191737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 392/796] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:49.192425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.202321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218791-a574-4506-aa12-717801369d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.204279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01218791-a574-4506-aa12-717801369d51 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-01218791-a574-4506-aa12-717801369d51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:49.227371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:49.228750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:49.229629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:49.229629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:49.229629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:49.229629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:49.231949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 405/797] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:49.232951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218791-a574-4506-aa12-717801369d51 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.317273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.323004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521536d-6cdc-4c65-a338-68ece08a7928 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.353491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01218791-a574-4506-aa12-717801369d51 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.366351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.367067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.367358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.367642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.368699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:49.369012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.370568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.385960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 393/798] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:49.385960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.398802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.399839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.400323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.400885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.401934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:49.402549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.404289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.417818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 406/799] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:49.419291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.451117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.512775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc494bb-e1e4-4a5b-8908-e40a6bedef19 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.547691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d6bf-8743-46d8-9403-8bb0a3007e89 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.553906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.554888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.555377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.555858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.556784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:49.557383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.559016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.573255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 394/800] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:49.574411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.584111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.590529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.591428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.591737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.592248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.605091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.607169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:49.629964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:49.631562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:49.632456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:49.632456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:49.632456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:49.632456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:49.636803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 407/801] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:49.637728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.695630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4271e7-81c0-4399-b892-aa2d8aeb09dd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.713213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.731232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.732021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.732304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.732578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.739741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.741836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.749280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49ec2b-a88f-4ec8-94d9-132702e89902 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:49.756141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:49.757055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 395/802] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:49.758206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.785644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac9457-95a1-4972-87f8-bf8c4d374f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.786434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9457-95a1-4972-87f8-bf8c4d374f60 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.786766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9457-95a1-4972-87f8-bf8c4d374f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.787607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac9457-95a1-4972-87f8-bf8c4d374f60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.794096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9457-95a1-4972-87f8-bf8c4d374f60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.795560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fac9457-95a1-4972-87f8-bf8c4d374f60 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-7fac9457-95a1-4972-87f8-bf8c4d374f60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:49.809648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:49.810548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:49.811460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 408/803] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:49.812298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabd7a-09d9-49ac-9e13-9f3eaf845b41 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.812568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabd7a-09d9-49ac-9e13-9f3eaf845b41 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.812844 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aabd7a-09d9-49ac-9e13-9f3eaf845b41 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.814080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 409/804] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:49.815168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d18383-bead-4217-842f-c2ade36f42ff None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.815468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d18383-bead-4217-842f-c2ade36f42ff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.815719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d18383-bead-4217-842f-c2ade36f42ff None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.816920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 410/805] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:49.817604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d18383-bead-4217-842f-c2ade36f42ff None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.865019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f48d5-2544-4008-baf1-1f1571e8c29b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.866073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.898742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.899458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.899740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.900013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.900727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:49.901031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.902380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.914286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 396/806] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:49.915089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:49.921776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d18383-bead-4217-842f-c2ade36f42ff None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:49.951043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:49.956069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d48c9-8a4c-47fe-85d3-555df616f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:49.956743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d48c9-8a4c-47fe-85d3-555df616f4dd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.957031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d48c9-8a4c-47fe-85d3-555df616f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.957306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d48c9-8a4c-47fe-85d3-555df616f4dd None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.958135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d48c9-8a4c-47fe-85d3-555df616f4dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:49.958444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d48c9-8a4c-47fe-85d3-555df616f4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:49.959935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d48c9-8a4c-47fe-85d3-555df616f4dd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:49.976997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 411/807] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:49.978183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b54de-ccdb-4cb7-bf5f-e4bec52d7dbe None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:49.978472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b54de-ccdb-4cb7-bf5f-e4bec52d7dbe None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:49.978753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b54de-ccdb-4cb7-bf5f-e4bec52d7dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:49.994787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-792b54de-ccdb-4cb7-bf5f-e4bec52d7dbe None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:49.995999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-792b54de-ccdb-4cb7-bf5f-e4bec52d7dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:50.014906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8ab0-dbee-4461-b2f8-bdc594e845f9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.048867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.049520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.049807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.050087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.050897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:50.051216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.052633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.061152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 412/808] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:50.062405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb783-5916-4618-bf6d-5e6c9999a451 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.062700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb783-5916-4618-bf6d-5e6c9999a451 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.063009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb783-5916-4618-bf6d-5e6c9999a451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.069818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 397/809] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:50.069818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.084415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-491cb783-5916-4618-bf6d-5e6c9999a451 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:50.085601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-491cb783-5916-4618-bf6d-5e6c9999a451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:50.113430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.156681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 413/810] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:50.157540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb783-5916-4618-bf6d-5e6c9999a451 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.180311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.187670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b5313-9b13-459f-bb7b-6a084099de68 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.223144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.223945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.224232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.225126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.233916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.235406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:50.249963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:50.251046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:59:50.252026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:50.255830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 398/811] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:50.256639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.285357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb783-5916-4618-bf6d-5e6c9999a451 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.322615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.323720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.324242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.324482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.335992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.337444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:50.355688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:50.356601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:50.357512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:50.357512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:50.357512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:50.357512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:50.357512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 414/812] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:50.357781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.366963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b6eefa-7889-4068-9252-78049e9c3c47 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.373671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.407201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.408147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.408521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.408868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/29b2238abdfd4140a850d53943fb931e/roles/8c8136abf46a401b83db6fa1665441a3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.427124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=29b2238abdfd4140a850d53943fb931e, role_id=8c8136abf46a401b83db6fa1665441a3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.429212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.442545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 399/813] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:50 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/29b2238abdfd4140a850d53943fb931e/roles/8c8136abf46a401b83db6fa1665441a3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:50.453992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.457210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.479729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af4e5-747b-4d08-a0dc-da0ef5365a6d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.521794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.522631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.523014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.523294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.523956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.525422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:50.538883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:50.539876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:50.540704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 415/814] 10.222.0.48 () {56 vars in 1129 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:50.541541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.573989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21b07-2950-4711-baab-e1b13e6a5a6c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.612884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.613696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.613980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.614482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.614944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.616894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:50.632404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:50.633458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:50.635262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 400/815] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:50.636082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.640574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.665369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980445a-588c-4c72-a1bd-c70c90bf8462 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.701998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.702794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.703229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.703507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.704342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:50.704709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.706283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.711078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.730868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 416/816] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:50.730868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.750422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97595172-3c8e-4983-914c-b2dc3569c7f0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.792005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.792685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.793077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.793367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.794095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:50.794408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.795815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.807791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 401/817] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:50.808617 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.862273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b728a0-9319-4c0e-8490-6be785a47192 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.895463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.896128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.896947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.897219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.897918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:50.898219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.899593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.901362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.909957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 417/818] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:50.909957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:50.926826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b45d7-95c1-4619-a505-937beed95347 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:50.957746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:50.965319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:50.965993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:50.966279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:50.966559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:50.967329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] RBAC: Adding query filter params (name=network) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:50.967630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:50.968971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:50.973481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 402/819] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:50.974258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.023751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e7372-5dfe-459b-b5b5-f50859642030 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.059864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.060526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.060801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.061076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.079204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ce15b-fa49-4546-a0e2-91fba9e80a98 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.113117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.113913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.114188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.114464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.122262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.124080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.138287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:51.142057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.143611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:51.143888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:51.144713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 403/820] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:51.146149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.208498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:51.256487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c034d-5dd4-47dc-b189-ea9ae56e6dee None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.261676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 418/821] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:59:51.262574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.290445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.291142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.291423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.291691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.292392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:51.292693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.294090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.303819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 404/822] 10.222.0.48 () {56 vars in 1124 bytes} [Thu May 26 19:59:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:51.303819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.371925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:51.375859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2c666-68ba-4541-ac23-623deb838d52 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.401725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc8dea-9e64-451e-90f9-d837067c634c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.411173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.412490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.412771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.413068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.413780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] RBAC: Adding query filter params (type=network) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:51.414087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.415583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.419433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:51.426090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 419/823] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 19:59:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:51.426090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.441790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.442449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.442729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.443028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.443833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:51.452427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.452427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.475686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 405/824] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:51.475686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.552896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db010dd5-8311-4db5-b2bf-6c43b0e5115d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.585556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2fcd48-64b6-4474-9966-b5df9dd988ee None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.588940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.589730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.590013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.590282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.602078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.603563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.620723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.624677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.624677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.624677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:51.624910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:51.625701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:51.626551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:51.626551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:51.626551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:51.626551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:51.626764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.626764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.629166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 420/825] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:51.629166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.654908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 406/826] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 19:59:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:51.654908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.665780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:51.704272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:51.761114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067346-eb08-4557-b933-ddfbf4d25db5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.814126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd35a15-992c-4e2f-94f8-a282633f74d4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:51.821334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.822015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.822298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.823278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.824044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.825998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.857244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 421/827] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 19:59:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:51.858607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:51.865205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:51.866376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:51.866827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:51.867307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/b80af2efebf440959ceb238bd27cf7f2/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:51.869856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=b80af2efebf440959ceb238bd27cf7f2, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:51.871734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:51.899995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 407/828] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 19:59:51 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/b80af2efebf440959ceb238bd27cf7f2/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:59:51.956012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:52.004161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1095-94a6-4f48-97b8-9941fb2e543d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:52.050518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:52.054911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:52.054911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:52.054911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:52.054911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:52.054911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:52.054911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:52.070747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 422/829] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:52.076449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:52.184209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:52.203049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf8285-9a79-4a6b-a431-cb0c4b1eac22 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:52.239327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:52.240674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:52.240958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:52.241234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:52.248578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:52.250023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:52.265218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:52.266211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:52.267127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:52.272058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:52.273084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 408/830] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:52.382248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ace166-7125-4b8f-804d-2cae4f29cbb3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:52.410199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:52.418868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597772b-9b17-4aba-9a4e-b1cac1f86ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:52.419558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597772b-9b17-4aba-9a4e-b1cac1f86ffb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:52.419840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597772b-9b17-4aba-9a4e-b1cac1f86ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:52.420114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597772b-9b17-4aba-9a4e-b1cac1f86ffb None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:52.420896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597772b-9b17-4aba-9a4e-b1cac1f86ffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:52.421203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597772b-9b17-4aba-9a4e-b1cac1f86ffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:52.422627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597772b-9b17-4aba-9a4e-b1cac1f86ffb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:52.435745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 423/831] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:52.441614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:52.555483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c2b454-341e-4e78-aea3-5bd648dfc719 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:52.595922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d551d-533d-4281-ba0c-e16aed99146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:52.596587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d551d-533d-4281-ba0c-e16aed99146c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:52.596869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d551d-533d-4281-ba0c-e16aed99146c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:52.597203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d551d-533d-4281-ba0c-e16aed99146c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:52.598039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d551d-533d-4281-ba0c-e16aed99146c None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=e8a59979309a45f98c0b4fb27af83c6e) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:52.598395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d551d-533d-4281-ba0c-e16aed99146c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:52.599890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d551d-533d-4281-ba0c-e16aed99146c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:52.606406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 409/832] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:52 2022] GET /identity/v3/role_assignments?user.id=e8a59979309a45f98c0b4fb27af83c6e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:52.765705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825781c-634e-4be7-9c7e-ada165329953 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:52.766355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825781c-634e-4be7-9c7e-ada165329953 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:52.766875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825781c-634e-4be7-9c7e-ada165329953 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:52.768805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 424/833] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:52.774903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abd79-3358-4ada-9e72-62c949df41a6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:52.775528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abd79-3358-4ada-9e72-62c949df41a6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:52.776012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abd79-3358-4ada-9e72-62c949df41a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:52.794632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-eb8abd79-3358-4ada-9e72-62c949df41a6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:52.795888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-eb8abd79-3358-4ada-9e72-62c949df41a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:52.799033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:52.871150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 410/834] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:59:52.894699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825781c-634e-4be7-9c7e-ada165329953 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:53.000231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825781c-634e-4be7-9c7e-ada165329953 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:53.034272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:53.035149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:53.035431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:53.035706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:53.047377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:53.055243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:53.056172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:53.057019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 425/835] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 19:59:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:53.062395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8abd79-3358-4ada-9e72-62c949df41a6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:53.171739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8abd79-3358-4ada-9e72-62c949df41a6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:53.207847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:53.209336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:53.209765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:53.210185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:53.211186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:53.211668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:53.213285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:53.223287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 411/836] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 19:59:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:53.229761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:53.279278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:53.333133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36173b28-e4eb-4c3a-800b-7d6eb285a1ba None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:53.368319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:53.369393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:53.369845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:53.370269 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:53.381176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:53.382813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:53.401860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:53.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:53.404094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:53.404094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:53.404094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:53.404094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:53.410174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 426/837] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:53.411711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:53.414732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:53.523012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a0a8d-0ad4-462b-b303-71ba14a6fa94 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:53.556656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:53.557320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:53.557605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:53.557881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:53.558599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:53.558930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:53.560289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:53.573344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 412/838] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:53.578966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:53.684729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:53.687629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c840ec-ccad-4670-b3b6-3060d06340cf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:53.723374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace975-bec1-432b-831e-9533313389ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:53.724191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace975-bec1-432b-831e-9533313389ff None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:53.724504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace975-bec1-432b-831e-9533313389ff None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:53.724778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace975-bec1-432b-831e-9533313389ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:53.732111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace975-bec1-432b-831e-9533313389ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:53.733609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace975-bec1-432b-831e-9533313389ff None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-feace975-bec1-432b-831e-9533313389ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:53.749000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:53.749933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:53.751358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 427/839] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 19:59:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:53.759968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:53.825333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:53.867657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7bb5ea-1b31-4719-a261-e050f4314bcb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:53.913102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0f806-4e94-43c8-8b25-fc15d422c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:53.913789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f806-4e94-43c8-8b25-fc15d422c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:53.914071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f806-4e94-43c8-8b25-fc15d422c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:53.914344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0f806-4e94-43c8-8b25-fc15d422c7f5 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:53.915222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f806-4e94-43c8-8b25-fc15d422c7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:53.915533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f806-4e94-43c8-8b25-fc15d422c7f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:53.916971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0f806-4e94-43c8-8b25-fc15d422c7f5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:53.936005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 413/840] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 19:59:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:53.944804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace975-bec1-432b-831e-9533313389ff None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.051396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace975-bec1-432b-831e-9533313389ff None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.087815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.088429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.088708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.089026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.117952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:54.159178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:54.160618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:54.205053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b544957-5f8a-47b4-9f4a-b774ef5bf8eb None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.205374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b544957-5f8a-47b4-9f4a-b774ef5bf8eb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.205608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b544957-5f8a-47b4-9f4a-b774ef5bf8eb None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.207316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 414/841] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:59:54.216156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167ee0f-71b6-463a-bf2b-ce2a7b26fede None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.216774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167ee0f-71b6-463a-bf2b-ce2a7b26fede None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.217259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167ee0f-71b6-463a-bf2b-ce2a7b26fede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.239592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e167ee0f-71b6-463a-bf2b-ce2a7b26fede None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:54.242509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e167ee0f-71b6-463a-bf2b-ce2a7b26fede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:54.284259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 428/842] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:53 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:59:54.292701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.336980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 415/843] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:54.359045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167ee0f-71b6-463a-bf2b-ce2a7b26fede None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.371198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:54.406785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c6708-bd48-4a03-ae7e-517a2ef02c1b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.410645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:54.445035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835c02c-3e8f-470e-9e77-b95a12402445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.445897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835c02c-3e8f-470e-9e77-b95a12402445 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.446118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835c02c-3e8f-470e-9e77-b95a12402445 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.446393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835c02c-3e8f-470e-9e77-b95a12402445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.457202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835c02c-3e8f-470e-9e77-b95a12402445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:54.458679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f835c02c-3e8f-470e-9e77-b95a12402445 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:54.464773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167ee0f-71b6-463a-bf2b-ce2a7b26fede None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-f835c02c-3e8f-470e-9e77-b95a12402445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:54.477608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:54.478519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:54.479460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:54.479460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:54.479460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:54.479460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:54.479460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 429/844] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:54.480244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a4a2-8a69-48d5-95cb-516e489ec043 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.480407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a4a2-8a69-48d5-95cb-516e489ec043 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.480662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a4a2-8a69-48d5-95cb-516e489ec043 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.482094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 430/845] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:54.486216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4a4a2-8a69-48d5-95cb-516e489ec043 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.508180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02eb786-14f8-4538-877b-f42a4860cabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.509076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eb786-14f8-4538-877b-f42a4860cabb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.509631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eb786-14f8-4538-877b-f42a4860cabb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.509756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eb786-14f8-4538-877b-f42a4860cabb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.510456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02eb786-14f8-4538-877b-f42a4860cabb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:54.511978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02eb786-14f8-4538-877b-f42a4860cabb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d02eb786-14f8-4538-877b-f42a4860cabb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:54.524861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:54.525892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:54.527362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 416/846] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:54.528135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37b11-1eeb-47be-8c39-69c99a48e1a8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.528135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37b11-1eeb-47be-8c39-69c99a48e1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.528135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a37b11-1eeb-47be-8c39-69c99a48e1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.545579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-92a37b11-1eeb-47be-8c39-69c99a48e1a8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:54.546773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-92a37b11-1eeb-47be-8c39-69c99a48e1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:54.599976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4a4a2-8a69-48d5-95cb-516e489ec043 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.613060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:54.626914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 417/847] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:54.626914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a37b11-1eeb-47be-8c39-69c99a48e1a8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.648662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.649353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.649647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.649918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.650644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:54.650987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:54.652359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:54.666988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 431/848] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:54.666988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.689615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:54.746240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a37b11-1eeb-47be-8c39-69c99a48e1a8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.774264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb76bc-1fa6-4dc6-9ef6-a6f779e58092 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.782810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.783535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.783822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.784101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.784809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:54.785117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:54.786490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:54.791564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 418/849] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:54.792346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.817649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.818746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.819502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.820002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.830879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:54.840046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:54.840954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:59:54.841777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:54.843980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 432/850] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:54.844987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.880100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:54.905401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aa98d-5ac5-4f2f-9a7c-49e0fd4f2123 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.916695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:54.948404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.949205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.949493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.949773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.952694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9bb11-fbb5-430c-9d5f-0428f911eb9e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:54.956675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:54.958240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:54.972665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:54.973577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:54.974484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:54.978477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 419/851] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:54.979270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:54.991339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:54.992350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:54.992794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:54.993078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:54.993786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:54.994174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:54.995491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.010877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 433/852] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:55.010877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.115829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:55.118453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464b627-0261-48ca-b429-b3480d281877 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.122740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714d3b-be07-4316-80fc-0e234baf3f5c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.157522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc013d-f635-4e03-8548-6e65359d3492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.158122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc013d-f635-4e03-8548-6e65359d3492 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.158410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc013d-f635-4e03-8548-6e65359d3492 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.158691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc013d-f635-4e03-8548-6e65359d3492 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.159486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc013d-f635-4e03-8548-6e65359d3492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:55.159800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc013d-f635-4e03-8548-6e65359d3492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.160771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3b15e-ca1a-4206-b460-0d27234399ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.161196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc013d-f635-4e03-8548-6e65359d3492 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.161443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3b15e-ca1a-4206-b460-0d27234399ac None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.161753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3b15e-ca1a-4206-b460-0d27234399ac None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.162027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3b15e-ca1a-4206-b460-0d27234399ac None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.162831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3b15e-ca1a-4206-b460-0d27234399ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:55.163164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3b15e-ca1a-4206-b460-0d27234399ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.164610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3b15e-ca1a-4206-b460-0d27234399ac None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.176203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 420/853] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 19:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:55.176203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27329797-52d9-4aba-98b4-26fa780035c2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.176203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27329797-52d9-4aba-98b4-26fa780035c2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.176203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27329797-52d9-4aba-98b4-26fa780035c2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.176203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 421/854] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:55.177607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27329797-52d9-4aba-98b4-26fa780035c2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.183466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 434/855] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:55.184782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688508ca-610f-433c-99ff-4f5e0e8bdc95 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.185073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688508ca-610f-433c-99ff-4f5e0e8bdc95 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.185353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688508ca-610f-433c-99ff-4f5e0e8bdc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.204219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-688508ca-610f-433c-99ff-4f5e0e8bdc95 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:55.205427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-688508ca-610f-433c-99ff-4f5e0e8bdc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:55.215104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:55.282369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 435/856] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:55.283416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688508ca-610f-433c-99ff-4f5e0e8bdc95 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.301118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27329797-52d9-4aba-98b4-26fa780035c2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.341137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.341967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.342252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.342526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.354449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.355929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:55.374713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:55.375660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:55.376570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:55.376570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:55.376570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:55.376570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:55.376785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:55.376858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 422/857] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:59:55.376858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.394697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688508ca-610f-433c-99ff-4f5e0e8bdc95 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.428980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.429635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.429836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.430115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.430973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=29b2238abdfd4140a850d53943fb931e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:55.431295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.432724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.438434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 436/858] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/role_assignments?user.id=29b2238abdfd4140a850d53943fb931e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:55.439271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.481283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:55.511471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c873ea4-85b6-49b9-b738-63aafe495e3f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.558281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.559727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.560474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.560953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.562306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.564411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:55.583758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:55.584916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:59:55.585830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:55.590189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 423/859] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:55.591968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832563c4-dc64-43f1-ab58-d7d19952aacf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.596797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.634424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.635748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.636234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.636735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.638362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:55.638893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.640996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.660781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 437/860] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:55.667404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.681568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:55.743419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbd225-9997-4671-bdf3-a54affb9e04e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.784281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.785336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.785809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.786092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.787385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:55.787699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.789117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.792268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fde3a-02d8-4a85-a35e-0e72e726b6fa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.795469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 424/861] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:55.801202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.815256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:55.832454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.833263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.833573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.833886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.841503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.843076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:55.858566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:55.859627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:55.860789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 438/862] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:55.866651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:55.924927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1be555-1b2d-47d7-90a0-b7837e01dacc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:55.955253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:55.963924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:55.964598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:55.964882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:55.965157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:55.965981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:55.966291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:55.967935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:55.979184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 425/863] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:59:55.992493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbc51c-1f29-4ca9-8ed6-4a206322c11f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:56.031431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:56.032135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:56.032423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:56.032766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:56.033646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:56.034004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:56.035592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:56.056699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 439/864] 10.222.0.48 () {56 vars in 1135 bytes} [Thu May 26 19:59:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:56.062225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:56.148504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:56.177353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15459322-0b39-4a31-be25-7bfe2d126dee None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:56.214359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:56.214984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:56.215277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:56.215562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:56.292279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:56.293717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:56.375915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:56.403904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 426/865] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:59:56.412492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:56.515759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad8a561-9b17-45cf-a41e-96bcacc727c3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:56.543438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:56.551520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:56.552396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:56.553188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:56.553467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:56.565355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:56.566812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:56.585150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:56.586100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:56.587371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:56.587371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:56.587371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:56.587371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:56.587371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 440/866] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:56.592057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:56.703179 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc9d7c-6147-434d-a535-642337737599 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:56.746166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:56.746983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:56.747200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:56.747483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:56.748229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:56.748540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:56.749945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:56.762871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 427/867] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:56.768102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:56.884566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19b34e-10f4-42e7-b15c-4e4b156627c4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:56.921970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:56.922773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:56.923184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:56.923457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:56.930716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:56.932200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:59:56.946769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:56.947724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:56.948588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 441/868] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:56.955634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:57.015201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:57.061121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cde2152-0417-41fa-b013-2b214d39436d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:57.098316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bedde3-fb20-4e9c-a94a-f72ca30fc218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:57.099481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bedde3-fb20-4e9c-a94a-f72ca30fc218 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:57.099988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bedde3-fb20-4e9c-a94a-f72ca30fc218 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:57.100486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bedde3-fb20-4e9c-a94a-f72ca30fc218 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:57.101540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bedde3-fb20-4e9c-a94a-f72ca30fc218 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:57.102068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bedde3-fb20-4e9c-a94a-f72ca30fc218 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:57.103813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bedde3-fb20-4e9c-a94a-f72ca30fc218 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:57.124436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 428/869] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 19:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:57.133217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:57.180788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:57.247334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbca4e4-b430-4784-b7b2-5efc49cf09aa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:57.283851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:57.284883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:57.285402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:57.285882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:57.288970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=b80af2efebf440959ceb238bd27cf7f2) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:57.289090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:57.290570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:57.291145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadaa50-be25-4c1d-b6f7-0f74adc0fe8b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:57.291653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadaa50-be25-4c1d-b6f7-0f74adc0fe8b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:57.292152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadaa50-be25-4c1d-b6f7-0f74adc0fe8b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:57.295185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 429/870] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:57.300203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae4ba-2409-4c8d-8f29-cb44e10914b8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:57.300741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae4ba-2409-4c8d-8f29-cb44e10914b8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:57.300868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 442/871] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 19:59:57 2022] GET /identity/v3/role_assignments?user.id=b80af2efebf440959ceb238bd27cf7f2&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:57.301561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7ae4ba-2409-4c8d-8f29-cb44e10914b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:57.325542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-de7ae4ba-2409-4c8d-8f29-cb44e10914b8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:57.327158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-de7ae4ba-2409-4c8d-8f29-cb44e10914b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:57.407042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 430/872] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:57.430255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:57.543175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78cde39-fcbe-44be-8638-1132c2d2d40b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:57.547414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:57.581569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcdc91-7620-4855-9b51-5390ec16fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:57.582590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdc91-7620-4855-9b51-5390ec16fa4b None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:57.583301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdc91-7620-4855-9b51-5390ec16fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:57.584305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcdc91-7620-4855-9b51-5390ec16fa4b None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:57.585243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcdc91-7620-4855-9b51-5390ec16fa4b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:57.586804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcdc91-7620-4855-9b51-5390ec16fa4b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:57.604683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 443/873] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 19:59:57 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:57.917214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643bbd7-743a-4f82-8115-dfbdf3c3bbdc None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:57.917214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643bbd7-743a-4f82-8115-dfbdf3c3bbdc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:57.917214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643bbd7-743a-4f82-8115-dfbdf3c3bbdc None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:57.919850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 431/874] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:57.925443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17519-c933-4783-8387-810b26f05497 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:57.925732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17519-c933-4783-8387-810b26f05497 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:57.926010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a17519-c933-4783-8387-810b26f05497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:57.942679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e2a17519-c933-4783-8387-810b26f05497 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:57.944673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e2a17519-c933-4783-8387-810b26f05497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:58.023186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 444/875] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:59:58.046120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643bbd7-743a-4f82-8115-dfbdf3c3bbdc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:58.073798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:58.154442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643bbd7-743a-4f82-8115-dfbdf3c3bbdc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:58.195696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333cf97c-5e0d-4dcb-986f-c4287ac36486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:58.196446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf97c-5e0d-4dcb-986f-c4287ac36486 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.196731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf97c-5e0d-4dcb-986f-c4287ac36486 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.197006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333cf97c-5e0d-4dcb-986f-c4287ac36486 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.207852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333cf97c-5e0d-4dcb-986f-c4287ac36486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-333cf97c-5e0d-4dcb-986f-c4287ac36486 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:59:58.216365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:58.217329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:58.218166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 432/876] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 19:59:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:58.223610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a17519-c933-4783-8387-810b26f05497 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:58.323475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:58.329339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a17519-c933-4783-8387-810b26f05497 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:58.365125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e145-183e-49b5-858b-6006f718390f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.365461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e145-183e-49b5-858b-6006f718390f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.365693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e145-183e-49b5-858b-6006f718390f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.367338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 433/877] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:58.369010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:58.369687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.369973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.370249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.374072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:58.374072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:58.374072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:58.375799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10a287-c9d9-4a94-9eed-7712c0a77395 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.376196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10a287-c9d9-4a94-9eed-7712c0a77395 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.376582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10a287-c9d9-4a94-9eed-7712c0a77395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.382496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 445/878] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 19:59:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:58.387848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:58.394089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fd10a287-c9d9-4a94-9eed-7712c0a77395 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:58.395413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fd10a287-c9d9-4a94-9eed-7712c0a77395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:58.472045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 434/879] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:59:58.495024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10a287-c9d9-4a94-9eed-7712c0a77395 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:58.506417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0173b64-2faf-42b8-8740-f1b5c023bea4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:58.511239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:58.547773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:58.548594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.548879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.549159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.566324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:58.569539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:58.595137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:58.596054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:58.596934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:58.596934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:58.596934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:58.596934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:58.599531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 446/880] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:58.604703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:58.615236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:58.637816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10a287-c9d9-4a94-9eed-7712c0a77395 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:58.673867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:58.674803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.675265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.675681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.676552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:58.678851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:58.697734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 435/881] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 19:59:58 2022] POST /identity/v3/services => generated 269 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:59:58.722556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09614fa0-eca4-496b-8f73-559da754f918 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:58.772058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:58.772791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.773080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.773358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.774088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:58.774398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:58.775819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:58.791533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 447/882] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:58.797251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:58.883203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:58.911069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ecce2-a94c-4728-8682-e5c61ab6e056 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:58.945839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:58.947339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:58.947767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:58.948209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:58.956033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:58.957647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:59:58.972261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:58.973435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:59:58.975189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 19:59:58.981732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 436/883] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 19:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:58.983282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:59.044586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:59.087608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fc2a2-e9ac-4822-a0a1-e125022d047e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:59.127352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:59.128026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.128311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.128586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.129411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:59.129716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:59.131197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:59.149729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 448/884] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 19:59:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:59.155335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:59.257097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab677b-7fea-4358-8d1f-4985827033a8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:59.292415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:59.293513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.294010 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.294496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.297530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:59.367961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:59.369480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:59.472953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 437/885] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 19:59:59 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:59:59.478359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:59.604892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f19185c-4779-4eb0-86de-0d0505b617f8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:59.635424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:59.654199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d939d9f5-7d29-4196-a9b3-647a924b4e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:59.655053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d9f5-7d29-4196-a9b3-647a924b4e72 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.655336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d9f5-7d29-4196-a9b3-647a924b4e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.655607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939d9f5-7d29-4196-a9b3-647a924b4e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.666064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939d9f5-7d29-4196-a9b3-647a924b4e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:59.667536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d939d9f5-7d29-4196-a9b3-647a924b4e72 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d939d9f5-7d29-4196-a9b3-647a924b4e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:59:59.686447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:59:59.687448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 19:59:59.688342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:59:59.688342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:59:59.688342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:59:59.688342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 19:59:59.692535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 449/886] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 19:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:59:59.694858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:59.731558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:59.766049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02137a83-4107-4247-9475-13bed8195ade None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.766684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02137a83-4107-4247-9475-13bed8195ade None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.767190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02137a83-4107-4247-9475-13bed8195ade None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.768998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 450/887] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:59:59.774265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527a1a-219f-4080-a4be-d1a8cfad743e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.774787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527a1a-219f-4080-a4be-d1a8cfad743e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.775312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed527a1a-219f-4080-a4be-d1a8cfad743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.792192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ed527a1a-219f-4080-a4be-d1a8cfad743e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:59.793389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ed527a1a-219f-4080-a4be-d1a8cfad743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:59.801407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52008-8874-480b-8a66-519ce8b6f44d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:59.843516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:59:59.844559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.845062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.845539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.846502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:59:59.847040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:59:59.848614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:59:59.861141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 438/888] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 19:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:59:59.870893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:59:59.875511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 451/889] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:59:59.888341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39296b-98c6-40d4-b1db-86776fd0dcfc None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.888637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39296b-98c6-40d4-b1db-86776fd0dcfc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.888923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39296b-98c6-40d4-b1db-86776fd0dcfc None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.890247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 452/890] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 19:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:59:59.895717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11efd1c-10e8-4c6d-b74c-1b491a13411c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:59:59.896042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11efd1c-10e8-4c6d-b74c-1b491a13411c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:59:59.896317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11efd1c-10e8-4c6d-b74c-1b491a13411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:59:59.915975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c11efd1c-10e8-4c6d-b74c-1b491a13411c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:59:59.917375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c11efd1c-10e8-4c6d-b74c-1b491a13411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:59:59.970560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:59:59.979274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccfe57-d783-45d0-af48-ba76ac0662f3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:59:59.993502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 453/891] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 19:59:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:59:59.994178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11efd1c-10e8-4c6d-b74c-1b491a13411c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.024875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.025088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:00.026046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.026471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.026995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.034259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.035735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:00:00.050220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:00.051180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 439/892] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 19:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:00.053351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.110136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11efd1c-10e8-4c6d-b74c-1b491a13411c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.149361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.150074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.150360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.150636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.151312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.152668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.158781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39df8-8ed7-4ff3-8438-1b4a3af91b6a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:00.165293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:00.166246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:00.167917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:00.171222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 454/893] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 19:59:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:00.172565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.195776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.196857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.197143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.197474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.198138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.199528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:00.211677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:00.212663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:00.213474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 440/894] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:00.214331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.235442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:00.276118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:00.284674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe3a9b-21a4-4e4d-830b-d81d33fec7cd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.320811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.321469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.321757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.322030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.322796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:00.323206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.324626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.325482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1a7f5-3921-45cd-9e64-167621079698 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.337188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 455/895] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:00.338081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.370099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.370767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.371080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.371357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.372066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:00.372373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.373742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.378426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 441/896] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:00.379237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.451754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a0fd9-9bd9-4ac6-b088-18d84d38f9ad None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.467236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:00.489251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195aedb2-8e72-4ed3-b4d8-7c1b72d67de6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.489456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.491066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.491539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.492073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.492778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:00.493079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.494432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.502874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 456/897] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:00.502874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.519861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:00.529141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.529801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.530089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.530370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.531230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] RBAC: Adding query filter params (role.id=89bc9e01f2f145ddb932bbea5bc944b7, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=29b2238abdfd4140a850d53943fb931e) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:00.531547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.532979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.539677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 442/898] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/role_assignments?user.id=29b2238abdfd4140a850d53943fb931e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=89bc9e01f2f145ddb932bbea5bc944b7 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:00.540088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.651049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce097f-05ec-4cb8-b8d0-e757f16f0fe1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.673665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf88863-d497-4760-a43e-7785e51e2668 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.701851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.703292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.703966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.704418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.705547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:00.706456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.709089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.715480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.720454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.720454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.720454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.720454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:00.720454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.720454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.721741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 457/899] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:00.734966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 443/900] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:00.736868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.832717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:00.855292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66c66e-fb6b-4105-9452-44cff36a4cf8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:00.899261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d319e-5e3b-43be-954e-96b14273cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:00.899998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d319e-5e3b-43be-954e-96b14273cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:00.900286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d319e-5e3b-43be-954e-96b14273cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:00.900562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d319e-5e3b-43be-954e-96b14273cfe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:00.901364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d319e-5e3b-43be-954e-96b14273cfe7 None admin] RBAC: Adding query filter params (interface=public, service_id=343b82a7cbcf41a4bd9d243d6ba5b95b, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:00.901676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d319e-5e3b-43be-954e-96b14273cfe7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:00.903117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d319e-5e3b-43be-954e-96b14273cfe7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:00.910524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 458/901] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/endpoints?service_id=343b82a7cbcf41a4bd9d243d6ba5b95b&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:00.915410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:00.929341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:01.020006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4479e1-145c-4a6a-81cb-7b6f7c893d7c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:01.055369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333104ae-b197-4bb6-9835-028baa87af57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:01.056048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333104ae-b197-4bb6-9835-028baa87af57 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:01.056330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333104ae-b197-4bb6-9835-028baa87af57 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:01.056605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333104ae-b197-4bb6-9835-028baa87af57 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:01.057292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333104ae-b197-4bb6-9835-028baa87af57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:01.058648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333104ae-b197-4bb6-9835-028baa87af57 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:01.064578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265def42-423c-468f-a551-1dd7d6c382ad None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:01.064876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265def42-423c-468f-a551-1dd7d6c382ad None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:01.065008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 444/902] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 20:00:00 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:00:01.065160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265def42-423c-468f-a551-1dd7d6c382ad None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:01.066747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 459/903] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:01.074976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5491683-ca81-4145-a6e8-6efb6a19a9c5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:01.074976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5491683-ca81-4145-a6e8-6efb6a19a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:01.074976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5491683-ca81-4145-a6e8-6efb6a19a9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:01.092458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b5491683-ca81-4145-a6e8-6efb6a19a9c5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:01.094000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b5491683-ca81-4145-a6e8-6efb6a19a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:01.192733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 445/904] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:01.215844 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265def42-423c-468f-a551-1dd7d6c382ad None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:01.331596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265def42-423c-468f-a551-1dd7d6c382ad None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:01.372015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:01.372835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:01.373116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:01.373388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:01.374038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:01.375451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:01.388388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:01.389328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:00:01.390155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:01.391131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 460/905] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 26 20:00:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:01.398186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5491683-ca81-4145-a6e8-6efb6a19a9c5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:01.403348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:01.510165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5491683-ca81-4145-a6e8-6efb6a19a9c5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:01.545746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:01.546878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:01.547177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:01.547506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:01.548219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:01.548533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:01.549904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:01.555520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 446/906] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:01.561099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:01.576671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:01.678345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb598-c72b-4f38-ab38-002477f3062b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:01.713518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:01.714520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:01.715051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:01.715529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:01.716425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:01.716959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:01.718506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:01.724540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 461/907] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:01.732970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:01.799080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:01.833898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a1596-1ee3-4f3a-a554-549872890d4a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:01.869277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2022db2-b3b2-4f15-aaa5-a82e3c624fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:01.869941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022db2-b3b2-4f15-aaa5-a82e3c624fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:01.870224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022db2-b3b2-4f15-aaa5-a82e3c624fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:01.870498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2022db2-b3b2-4f15-aaa5-a82e3c624fd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:01.871360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022db2-b3b2-4f15-aaa5-a82e3c624fd4 None admin] RBAC: Adding query filter params (interface=public, service_id=c3e8977d371b4e5c9fe76483c143a8e5, region_id=RegionOne) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:01.871674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022db2-b3b2-4f15-aaa5-a82e3c624fd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:01.873030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2022db2-b3b2-4f15-aaa5-a82e3c624fd4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:01.878509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 447/908] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 20:00:01 2022] GET /identity/v3/endpoints?service_id=c3e8977d371b4e5c9fe76483c143a8e5&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:01.884033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:01.971965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:01.992982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161d55-7e02-4e7b-ac62-32f992d6da77 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:02.029155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7acc0-325d-438c-ba67-c494da956fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:02.030173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7acc0-325d-438c-ba67-c494da956fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:02.030664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7acc0-325d-438c-ba67-c494da956fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:02.031186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7acc0-325d-438c-ba67-c494da956fc5 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:02.032093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7acc0-325d-438c-ba67-c494da956fc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:02.033669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7acc0-325d-438c-ba67-c494da956fc5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:02.040631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 462/909] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 20:00:01 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:00:02.796646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df1027-9a40-4dde-b767-6686c4945c03 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:02.797190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df1027-9a40-4dde-b767-6686c4945c03 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:02.797190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df1027-9a40-4dde-b767-6686c4945c03 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:02.798889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 448/910] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:02.804154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962df2f-3a60-4bc2-af34-fa9da77e3add None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:02.804573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962df2f-3a60-4bc2-af34-fa9da77e3add None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:02.804765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962df2f-3a60-4bc2-af34-fa9da77e3add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:02.822040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8962df2f-3a60-4bc2-af34-fa9da77e3add None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:02.823335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8962df2f-3a60-4bc2-af34-fa9da77e3add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:02.898832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 463/911] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:02.921011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df1027-9a40-4dde-b767-6686c4945c03 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.033409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df1027-9a40-4dde-b767-6686c4945c03 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:03.058250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae025-474c-49f1-a4f6-587bb7702a5b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.058561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae025-474c-49f1-a4f6-587bb7702a5b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.058803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1ae025-474c-49f1-a4f6-587bb7702a5b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.061190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 464/912] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:03.065972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b044d-789a-423a-89f6-cec7b7f74b83 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.066520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b044d-789a-423a-89f6-cec7b7f74b83 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.067027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3b044d-789a-423a-89f6-cec7b7f74b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.069824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:03.076409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:03.077251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.077549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.077836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.088631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bf3b044d-789a-423a-89f6-cec7b7f74b83 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:03.090154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bf3b044d-789a-423a-89f6-cec7b7f74b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:03.093049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:03.104186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:03.105164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:03.106003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 449/913] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 20:00:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:03.111549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.165529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:03.172533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 465/914] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:03.202417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b044d-789a-423a-89f6-cec7b7f74b83 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.251982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fa27b-8990-42c6-a7c8-f12637279ee3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:03.290596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:03.291369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.291662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.291943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.292723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:03.293069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:03.294468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:03.309362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 450/915] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 20:00:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:03.315482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.347101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3b044d-789a-423a-89f6-cec7b7f74b83 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:03.384434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:03.402507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd0b5ab-d288-4c03-b0bf-26e696fc412e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:03.403250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b5ab-d288-4c03-b0bf-26e696fc412e None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.403539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b5ab-d288-4c03-b0bf-26e696fc412e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.403818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd0b5ab-d288-4c03-b0bf-26e696fc412e None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.404624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0b5ab-d288-4c03-b0bf-26e696fc412e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:03.406866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd0b5ab-d288-4c03-b0bf-26e696fc412e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:03.425947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 466/916] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 20:00:03 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:00:03.443543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb3d54-5923-42e7-aa7a-dbc70b947098 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:03.494294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:03.494294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.494294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.496531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.516242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:03.517818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:03.526600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05af1f-f543-47aa-a767-efc650ee8849 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.526941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05af1f-f543-47aa-a767-efc650ee8849 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.527253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05af1f-f543-47aa-a767-efc650ee8849 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.529042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 467/917] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:03.538718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80830d2c-6e66-4284-bd09-254bebb0901e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.539281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80830d2c-6e66-4284-bd09-254bebb0901e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.539760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80830d2c-6e66-4284-bd09-254bebb0901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:03.543298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:03.545042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:03.547277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:03.547277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:03.547277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:03.547277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:03.547277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 451/918] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:03.552383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.566098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-80830d2c-6e66-4284-bd09-254bebb0901e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:03.567797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-80830d2c-6e66-4284-bd09-254bebb0901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:03.639932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:03.650764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 468/919] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:03.676563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80830d2c-6e66-4284-bd09-254bebb0901e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.697131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370028ac-eadf-4b76-9c84-7beeec4d2d8e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:03.698975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:03.746644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:03.747588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.748289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.748574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.749624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:03.749980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:03.752347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:03.768581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 452/920] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:03.780330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.797791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80830d2c-6e66-4284-bd09-254bebb0901e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:03.842139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:03.843217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.843668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.843952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.844929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:03.846311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:03.862679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:03.863713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:03.865486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 469/921] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 20:00:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:03.871169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:03.920233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a33ad-f34a-41a4-b6c6-86f701c0db1e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:03.942805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:03.974370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:03.975959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:03.976314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:03.976660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:03.987051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:03.989124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.002885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d991a-7d1a-45c5-ba02-0f214e3e5adb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:00:04.009659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:04.011228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:00:04.013242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:04.015692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 453/922] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 20:00:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:04.022866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.048726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.049401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.050007 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:04.050901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.051580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.053351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:04.053662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.056860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.063477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 470/923] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 20:00:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:04.068696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.137547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492f859-6d96-4a87-b6f1-444dd3b78f66 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.172497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dacbf3e-d156-4be5-80df-a25fb3a0e2f2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.173980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.174738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.175175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.175460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.176313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:04.176633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.178655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.191079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:04.199817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 454/924] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:04.205783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.221688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.223012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.223349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.223633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.224892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:04.225205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.227491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.238960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 471/925] 10.222.0.48 () {56 vars in 1114 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:04.241300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.305909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:04.328046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9cfaf-ed35-4909-b9d5-9dc6bfd25d1e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.348526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8637b-5713-4ef7-9cac-92df78e1fa86 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.368128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331ea21-1cd7-4177-8b05-3a7ceb68f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.368959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ea21-1cd7-4177-8b05-3a7ceb68f257 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.369249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ea21-1cd7-4177-8b05-3a7ceb68f257 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.369529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331ea21-1cd7-4177-8b05-3a7ceb68f257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.380494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331ea21-1cd7-4177-8b05-3a7ceb68f257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.382156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331ea21-1cd7-4177-8b05-3a7ceb68f257 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.387260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a77532-689d-4142-8c25-a606bf39d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.388147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77532-689d-4142-8c25-a606bf39d035 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.388735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77532-689d-4142-8c25-a606bf39d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.389193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a77532-689d-4142-8c25-a606bf39d035 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.390094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a77532-689d-4142-8c25-a606bf39d035 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.391698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a77532-689d-4142-8c25-a606bf39d035 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0331ea21-1cd7-4177-8b05-3a7ceb68f257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:04.400785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:04.401643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 455/926] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91c2ad-5cca-4d11-87ec-0b74f110bc30 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91c2ad-5cca-4d11-87ec-0b74f110bc30 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91c2ad-5cca-4d11-87ec-0b74f110bc30 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.407812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 456/927] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:04.408383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91c2ad-5cca-4d11-87ec-0b74f110bc30 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.419668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 472/928] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 20:00:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:00:04.419668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199d02-dd92-4de6-b932-2967e27c5f43 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.427743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199d02-dd92-4de6-b932-2967e27c5f43 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.427881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0199d02-dd92-4de6-b932-2967e27c5f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.448790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f0199d02-dd92-4de6-b932-2967e27c5f43 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:04.450249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f0199d02-dd92-4de6-b932-2967e27c5f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:04.486238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:04.551372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 473/929] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:04.560511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91c2ad-5cca-4d11-87ec-0b74f110bc30 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.568616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199d02-dd92-4de6-b932-2967e27c5f43 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.603495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:04.610390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.611704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.613239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.613713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.615253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:04.615787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.617416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.636813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 457/930] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:04.642702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.706675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0199d02-dd92-4de6-b932-2967e27c5f43 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.756022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.756835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.757119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.757392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.758224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.759688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:04.772520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:04.773486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:04.774737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 474/931] 10.222.0.48 () {56 vars in 1132 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:04.775609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94117aed-1887-40a7-9578-a1155c99a4e6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.784015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.816079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.817290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.817817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.818399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.822026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:04.826421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.828229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:00:04.843564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:04.844532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:04.845404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:04.847928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 458/932] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:04.858870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.902960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5161b-117a-4b62-8486-1d4cb7caf3bc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:04.922491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:04.938358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:04.939178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:04.939490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:04.939759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:04.940580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:04.940952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:04.942383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:04.952814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 475/933] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:04.953841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:04.986352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc3e6-6c0d-449d-bb1d-1d0471e3975d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:05.023290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:05.023986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:05.024269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:05.024546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:05.025333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:05.025641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:05.027164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:05.045396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 459/934] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:05.046281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:05.066027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa4ee7-bcb0-4f28-87dc-a456991cd7ba None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:05.099793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:05.103834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:05.104732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:05.105245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:05.105736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:05.106795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:05.107375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:05.108942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:05.120461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 476/935] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:04 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:05.121625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:05.153756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b829f4-0bb7-49bd-90fe-32eef2dbff61 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:05.168338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:05.191089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23979163-664f-4a40-bc33-ac79f19780bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:05.192131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23979163-664f-4a40-bc33-ac79f19780bb None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:05.192479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23979163-664f-4a40-bc33-ac79f19780bb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:05.193037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23979163-664f-4a40-bc33-ac79f19780bb None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/29b2238abdfd4140a850d53943fb931e/roles/89bc9e01f2f145ddb932bbea5bc944b7` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:05.195486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23979163-664f-4a40-bc33-ac79f19780bb None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=29b2238abdfd4140a850d53943fb931e, role_id=89bc9e01f2f145ddb932bbea5bc944b7)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:05.197111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23979163-664f-4a40-bc33-ac79f19780bb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:05.214925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 460/936] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:00:05 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/29b2238abdfd4140a850d53943fb931e/roles/89bc9e01f2f145ddb932bbea5bc944b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:00:05.247450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70580e4a-b882-4b00-afb8-014a7453ef01 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:05.288363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d64009-98c4-48aa-aab6-9c51b5338a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:05.289421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64009-98c4-48aa-aab6-9c51b5338a94 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:05.290166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64009-98c4-48aa-aab6-9c51b5338a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:05.290658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d64009-98c4-48aa-aab6-9c51b5338a94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:05.291746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d64009-98c4-48aa-aab6-9c51b5338a94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:05.293452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d64009-98c4-48aa-aab6-9c51b5338a94 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:05.319083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 477/937] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 20:00:05 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:05.784670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85822bc9-93ee-4aae-8d88-310fd31c9609 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:05.785066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85822bc9-93ee-4aae-8d88-310fd31c9609 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:05.785271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85822bc9-93ee-4aae-8d88-310fd31c9609 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:05.786904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 461/938] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:05.792363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eba74-5b34-48cd-954c-b10e2175f5cc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:05.792659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eba74-5b34-48cd-954c-b10e2175f5cc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:05.792937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351eba74-5b34-48cd-954c-b10e2175f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:05.811302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-351eba74-5b34-48cd-954c-b10e2175f5cc None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:05.812487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-351eba74-5b34-48cd-954c-b10e2175f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:05.816284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:05.897903 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 478/939] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:05.919898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85822bc9-93ee-4aae-8d88-310fd31c9609 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:06.037782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85822bc9-93ee-4aae-8d88-310fd31c9609 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:06.073666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:06.074473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:06.074751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:06.075052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:06.075706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:06.077255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:06.089651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:06.090676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:06.091566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 462/940] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:06.097014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eba74-5b34-48cd-954c-b10e2175f5cc None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:06.202874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351eba74-5b34-48cd-954c-b10e2175f5cc None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:06.239013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:06.240266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:06.240550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:06.240824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:06.241536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:06.241842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:06.243237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:06.245075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:06.248955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 479/941] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:06.254857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:06.295518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:06.365075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fcf85-5402-4eda-8b87-017f2e9b7a1c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:06.398559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:06.399254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:06.399538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:06.399815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:06.400521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:06.400826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:06.402246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:06.410948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 463/942] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:06.413877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:06.519944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d482b-f562-4d83-aecb-ed4804a4d9f3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:06.561274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a5a96f-ee30-43d4-b36b-1611f4f5139e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:06.561938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a96f-ee30-43d4-b36b-1611f4f5139e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:06.562220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a96f-ee30-43d4-b36b-1611f4f5139e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:06.562495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a5a96f-ee30-43d4-b36b-1611f4f5139e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:06.563321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a96f-ee30-43d4-b36b-1611f4f5139e None admin] RBAC: Adding query filter params (interface=public, service_id=776ea071560c404ebfe1158d7154886e, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:06.563632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a96f-ee30-43d4-b36b-1611f4f5139e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:06.565115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a5a96f-ee30-43d4-b36b-1611f4f5139e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:06.575016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 480/943] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 20:00:06 2022] GET /identity/v3/endpoints?service_id=776ea071560c404ebfe1158d7154886e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:06.576705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:06.697127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:06.700560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445344-d3f2-4122-b390-bc4c41ee6c95 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:06.728848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb166-f43c-4ef0-b496-b160f6785747 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:06.729154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb166-f43c-4ef0-b496-b160f6785747 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:06.729409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3eb166-f43c-4ef0-b496-b160f6785747 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:06.731071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 481/944] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:06.735734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841efa-639c-4d63-966a-8351c4a11881 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:06.736071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841efa-639c-4d63-966a-8351c4a11881 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:06.736279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841efa-639c-4d63-966a-8351c4a11881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:06.736676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:06.737337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:06.737617 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:06.737891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:06.738582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:06.740002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:06.746297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 464/945] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 20:00:06 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:00:06.757714 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-30841efa-639c-4d63-966a-8351c4a11881 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:06.758970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-30841efa-639c-4d63-966a-8351c4a11881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:06.825717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:06.843133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 482/946] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:06.859685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:06.973559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b920bd27-a295-461c-a5bf-8c7dd1afaa50 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:07.017922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:07.018591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.018908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.019191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.019915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:07.022046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:07.023454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING keystone.server.flask.common [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 20:00:07.044100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.sql.core [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 20:00:07.044100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 20:00:07.044100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [parameters: {'id': '0682506caa3c40ee82f84a0b7ea15270', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 20:00:07.044100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0682506caa3c40ee82f84a0b7ea15270.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0682506caa3c40ee82f84a0b7ea15270. May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:00:07.061286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 20:00:07.062137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application yield resource May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.rollback() May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.force_reraise() May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise self.value May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application session.commit() May 26 20:00:07.063120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._prepare_impl() May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.flush() May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._flush(objects) May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application compat.raise_( May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application flush_context.execute() May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 20:00:07.064016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rec.execute(self) May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 20:00:07.064897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:00:07.065686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [parameters: {'id': '0682506caa3c40ee82f84a0b7ea15270', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:07.066570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:07.069834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0682506caa3c40ee82f84a0b7ea15270. May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.071916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 465/947] 10.222.0.48 () {60 vars in 1140 bytes} [Thu May 26 20:00:06 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:07.079360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841efa-639c-4d63-966a-8351c4a11881 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:07.175077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841efa-639c-4d63-966a-8351c4a11881 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:07.211755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778376cf-6f9c-4aac-9fb2-415a9d4db67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:07.212561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778376cf-6f9c-4aac-9fb2-415a9d4db67f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.212842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778376cf-6f9c-4aac-9fb2-415a9d4db67f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.213116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778376cf-6f9c-4aac-9fb2-415a9d4db67f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.220334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778376cf-6f9c-4aac-9fb2-415a9d4db67f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:07.221777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778376cf-6f9c-4aac-9fb2-415a9d4db67f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-778376cf-6f9c-4aac-9fb2-415a9d4db67f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:00:07.236030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:07.238020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:07.240652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:07.241631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 483/948] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:07.248172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:07.279421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:07.382289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae62ce-7fd4-48da-b800-09b5f7667409 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:07.419416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047a956-17d6-4e3d-823f-dc5a22ea062e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:07.420462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a956-17d6-4e3d-823f-dc5a22ea062e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.420982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a956-17d6-4e3d-823f-dc5a22ea062e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.421453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047a956-17d6-4e3d-823f-dc5a22ea062e None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.422404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047a956-17d6-4e3d-823f-dc5a22ea062e None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:07.422932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047a956-17d6-4e3d-823f-dc5a22ea062e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:07.424761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047a956-17d6-4e3d-823f-dc5a22ea062e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:07.447777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 466/949] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 20:00:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:07.649935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfecef3-f4d2-4d14-a9e9-2723a2463c46 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.650257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfecef3-f4d2-4d14-a9e9-2723a2463c46 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.650500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfecef3-f4d2-4d14-a9e9-2723a2463c46 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.657098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 484/950] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:07.664587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8c8a-a2f2-4fad-a43b-7ad1567ac6ea None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.665304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8c8a-a2f2-4fad-a43b-7ad1567ac6ea None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.665799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a8c8a-a2f2-4fad-a43b-7ad1567ac6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.689396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f30a8c8a-a2f2-4fad-a43b-7ad1567ac6ea None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:07.693479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f30a8c8a-a2f2-4fad-a43b-7ad1567ac6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:07.702267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9f433-3726-4615-b59d-fec26104f863 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.702267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9f433-3726-4615-b59d-fec26104f863 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.702267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9f433-3726-4615-b59d-fec26104f863 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.707613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 485/951] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:07.708614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea507-ab5a-48c2-9dd8-269ee27693eb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.708907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea507-ab5a-48c2-9dd8-269ee27693eb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.709186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bea507-ab5a-48c2-9dd8-269ee27693eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.732991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-28bea507-ab5a-48c2-9dd8-269ee27693eb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:07.734475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-28bea507-ab5a-48c2-9dd8-269ee27693eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:07.789999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 467/952] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:07.799203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:07.813306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8c8a-a2f2-4fad-a43b-7ad1567ac6ea None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:07.821543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 486/953] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:07.830668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:07.844506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea507-ab5a-48c2-9dd8-269ee27693eb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:07.923750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a8c8a-a2f2-4fad-a43b-7ad1567ac6ea None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:07.949747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bea507-ab5a-48c2-9dd8-269ee27693eb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:07.960239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:07.961339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.961832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.962313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.973126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:07.982237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:07.983250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:07.984146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:07.984816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 468/954] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 20:00:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:07.991731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:07.993735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:07.994595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:07.994904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:07.995184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:07.995881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:07.997681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:08.010226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:08.011550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:08.012404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:08.016815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 487/955] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:08.018166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:08.075236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:08.083784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:08.112897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ab209-10bc-458d-a1ef-311f1c064efc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:08.126308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee19a5-7a6c-43e5-bcb0-3c6e6cc4bc5c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:08.150649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:08.151762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:08.152273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:08.152753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:08.153925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:08.154454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:08.156161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.162277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:08.163138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:08.163278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:08.163510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:08.164209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:08.164514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:08.165864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.172087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 469/956] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 20:00:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:08.175035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 488/957] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 20:00:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:08.176136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:08.177358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:08.286109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8dc02a-6fb8-4703-9bc7-a1718c5c523f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:08.287277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ac6fa-ba86-4e85-acdb-dffb0a327b5b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:08.301176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:08.320068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:08.325859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:08.326716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:08.327016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:08.327622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:08.328235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:08.328551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:08.328976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:08.329412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:08.330287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:08.330789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:08.332441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.342735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:08.342956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.343541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 489/958] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 20:00:08 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:08.363801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:08.364851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:08.365775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:08.365775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:08.365775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:08.365775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:08.365775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 470/959] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:08.371695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:08.483977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02246273-9fe0-4f50-8889-9babc37e935b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:08.522336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:08.523385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:08.523864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:08.524356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:08.525268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:08.525771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:08.527398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.541098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 490/960] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:08.546740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:08.660543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba93ae3-e01e-46b4-bfda-3f54fe4e19f1 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:08.703333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:08.704160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:08.704442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:08.704721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:08.713709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:08.715195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:00:08.730674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:08.731691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:08.733132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 471/961] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 20:00:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:08.737947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:08.779307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:08.846784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c7ef0-ae27-456b-8eac-1b17fbbee304 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:08.883227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7b27b-3de0-491f-a36c-880af54d34fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:08.883908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b27b-3de0-491f-a36c-880af54d34fe None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:08.884231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b27b-3de0-491f-a36c-880af54d34fe None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:08.884518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7b27b-3de0-491f-a36c-880af54d34fe None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:08.885356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b27b-3de0-491f-a36c-880af54d34fe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:08.885663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b27b-3de0-491f-a36c-880af54d34fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:08.887123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7b27b-3de0-491f-a36c-880af54d34fe None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:08.905511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 491/962] 10.222.0.48 () {56 vars in 1149 bytes} [Thu May 26 20:00:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:08.911234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:08.962027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:09.023485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be50657-37c7-4206-bd79-7230ceb6e944 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.058152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:09.058804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.059118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.059397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.128875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:09.130902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:09.176317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:09.180568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c19f-4bac-4ef5-938c-3846ecd3d4a9 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.181100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c19f-4bac-4ef5-938c-3846ecd3d4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.181100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c19f-4bac-4ef5-938c-3846ecd3d4a9 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.182747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 492/963] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:09.188089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1acc2-0d24-4854-8295-95b4ac786ac2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.188382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1acc2-0d24-4854-8295-95b4ac786ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.188659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1acc2-0d24-4854-8295-95b4ac786ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.206900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-98e1acc2-0d24-4854-8295-95b4ac786ac2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:09.209104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-98e1acc2-0d24-4854-8295-95b4ac786ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:09.234371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 472/964] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:08 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:09.240085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.291698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 493/965] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:09.313925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1acc2-0d24-4854-8295-95b4ac786ac2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.347266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:09.356851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06ce33-a12c-4644-952b-968a95c9e9ff None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.396194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:09.397498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.397988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.398466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.409971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:09.411957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:09.415295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:09.433418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:09.434363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:09.435641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:09.435641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:09.435641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:09.435641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:09.441923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1acc2-0d24-4854-8295-95b4ac786ac2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.443022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 473/966] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:09.444426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.485285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:09.486100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.486384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.486661 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.487342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:09.488707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:09.506206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:09.507375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:09.508326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:09.510921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 494/967] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:09.513925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.577191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f371f-9db5-4a72-9612-b1891f2c0258 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.621651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:09.631142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:09.632380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.632850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.633559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.635009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:09.635770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:09.637346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:09.637674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1e285-5a85-4ee8-a995-7826d3638b5f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.654660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 474/968] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:09.659707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.674746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:09.675664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.676000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.676367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.677760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:09.678312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:09.679706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:09.689746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 495/969] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:09.690710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.736021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:09.783718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf3eb8-4eb6-4fdf-ba6b-b6ebdef5d244 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.809734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f924db-f009-4278-a106-1ee0ac518e37 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.819652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a0fcbc-fe76-489e-965e-66924f4b42be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:09.820450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0fcbc-fe76-489e-965e-66924f4b42be None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.820729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0fcbc-fe76-489e-965e-66924f4b42be None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.821000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a0fcbc-fe76-489e-965e-66924f4b42be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.828028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0fcbc-fe76-489e-965e-66924f4b42be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:09.829395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a0fcbc-fe76-489e-965e-66924f4b42be None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:09.844677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74082509-cfba-4c03-9f9e-8602c485f34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d4a0fcbc-fe76-489e-965e-66924f4b42be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:00:09.844821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:09.845626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:09.847268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:09.847698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082509-cfba-4c03-9f9e-8602c485f34e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.847698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082509-cfba-4c03-9f9e-8602c485f34e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.847698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74082509-cfba-4c03-9f9e-8602c485f34e None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.847892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 475/970] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:09.847968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082509-cfba-4c03-9f9e-8602c485f34e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:09.847968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082509-cfba-4c03-9f9e-8602c485f34e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:09.848120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979131-8664-412c-8868-98fb933f16d9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.848120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979131-8664-412c-8868-98fb933f16d9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.848120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21979131-8664-412c-8868-98fb933f16d9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.848315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74082509-cfba-4c03-9f9e-8602c485f34e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:09.849575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 476/971] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:09.851380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979131-8664-412c-8868-98fb933f16d9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.854547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 496/972] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:09.857281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232e60-fc61-483d-bbb4-7d14159536b2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:09.857785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232e60-fc61-483d-bbb4-7d14159536b2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:09.858300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24232e60-fc61-483d-bbb4-7d14159536b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:09.879252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-24232e60-fc61-483d-bbb4-7d14159536b2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:09.881415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-24232e60-fc61-483d-bbb4-7d14159536b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:09.895379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:09.963481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21979131-8664-412c-8868-98fb933f16d9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:09.965482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 497/973] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:09.966105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24232e60-fc61-483d-bbb4-7d14159536b2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:09.987387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:10.010594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:10.011601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.011890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.012172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.012959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:10.013271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:10.014696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:10.027018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 477/974] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:10.027797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:10.075882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24232e60-fc61-483d-bbb4-7d14159536b2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:10.109917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:10.110576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.110874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.111155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.111887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:10.113236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:10.133580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 498/975] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 20:00:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:10.134463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:10.137330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:10.150418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743982-5ceb-4c5a-b1e7-01133b91b21e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:10.199334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:10.200402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.200935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.201440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.202371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:10.204337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:10.219802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.sql.core [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 20:00:10.219802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 20:00:10.219802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [parameters: {'user_id': '60a1a16a81604c49b6586ebbb68c624a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 20:00:10.219802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80412) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 26 20:00:10.229592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:00:10.230539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application yield resource May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application next(self.gen) May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.rollback() May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.force_reraise() May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise self.value May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application session.commit() May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 20:00:10.231509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._prepare_impl() May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.session.flush() May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._flush(objects) May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application compat.raise_( May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application flush_context.execute() May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rec.execute(self) May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 20:00:10.232436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 20:00:10.234014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result = self._query(query) May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application conn.query(q) May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application result.read() May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 20:00:10.234831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [parameters: {'user_id': '60a1a16a81604c49b6586ebbb68c624a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:10.235702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 20:00:10.236485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 20:00:10.238767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 20:00:10.238767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 20:00:10.238767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 20:00:10.238767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 20:00:10.238767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 20:00:10.238767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:10.242227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 478/976] 10.222.0.48 () {60 vars in 1131 bytes} [Thu May 26 20:00:10 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:10.256185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093243d2-097f-4f39-a12d-a627579bebe9 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:10.258412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:10.298562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:10.299330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.299623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.299932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.300941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] RBAC: Adding query filter params (role.id=89bc9e01f2f145ddb932bbea5bc944b7, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=29b2238abdfd4140a850d53943fb931e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:10.301300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:10.303035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:10.310230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:10.312539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 499/977] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:10 2022] GET /identity/v3/role_assignments?user.id=29b2238abdfd4140a850d53943fb931e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=89bc9e01f2f145ddb932bbea5bc944b7 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:10.392834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293db57f-8cfe-496a-bcbc-aabf18288a5b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:10.432725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf704a-1a2a-40fb-b0b8-b5f06d088a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:10.433537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf704a-1a2a-40fb-b0b8-b5f06d088a03 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.433823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf704a-1a2a-40fb-b0b8-b5f06d088a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.434102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf704a-1a2a-40fb-b0b8-b5f06d088a03 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.442946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf704a-1a2a-40fb-b0b8-b5f06d088a03 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:10.444887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf704a-1a2a-40fb-b0b8-b5f06d088a03 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-66cf704a-1a2a-40fb-b0b8-b5f06d088a03 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:00:10.461205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:10.462436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:10.463585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 479/978] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:00:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:10.470690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:10.555289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:10.594694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd428af7-f0f9-4b7a-b8d5-fb31d1cb46ec None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:10.630629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee68b2f5-2677-4929-95cf-a86731d12064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:10.631390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68b2f5-2677-4929-95cf-a86731d12064 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.631677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68b2f5-2677-4929-95cf-a86731d12064 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.634802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee68b2f5-2677-4929-95cf-a86731d12064 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.634802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68b2f5-2677-4929-95cf-a86731d12064 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:10.634802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68b2f5-2677-4929-95cf-a86731d12064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:10.634802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee68b2f5-2677-4929-95cf-a86731d12064 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:10.673636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 500/979] 10.222.0.48 () {56 vars in 1101 bytes} [Thu May 26 20:00:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:10.702063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12173475-85e0-4bb8-87e1-85b00d5638d1 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.702450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12173475-85e0-4bb8-87e1-85b00d5638d1 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.702735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12173475-85e0-4bb8-87e1-85b00d5638d1 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.707385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 480/980] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:10.713999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce10e1b-50ee-4d5b-b1c0-3452d3409923 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.714314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce10e1b-50ee-4d5b-b1c0-3452d3409923 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.714576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce10e1b-50ee-4d5b-b1c0-3452d3409923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.732641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fce10e1b-50ee-4d5b-b1c0-3452d3409923 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:10.733880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fce10e1b-50ee-4d5b-b1c0-3452d3409923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:10.811743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 501/981] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:10.835828 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12173475-85e0-4bb8-87e1-85b00d5638d1 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:10.939861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:10.953851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12173475-85e0-4bb8-87e1-85b00d5638d1 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:10.990443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2fd4d4-341b-431c-b338-d6eb5f6307fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:10.991484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd4d4-341b-431c-b338-d6eb5f6307fb None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:10.991969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd4d4-341b-431c-b338-d6eb5f6307fb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:10.992459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2fd4d4-341b-431c-b338-d6eb5f6307fb None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:10.993469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd4d4-341b-431c-b338-d6eb5f6307fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:10.995049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2fd4d4-341b-431c-b338-d6eb5f6307fb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:11.008925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 481/982] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 20:00:10 2022] POST /identity/v3/services => generated 242 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:12.434445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad40a5f-e48e-41dd-875a-8e92021c4e5c None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:12.435198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad40a5f-e48e-41dd-875a-8e92021c4e5c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:12.435198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad40a5f-e48e-41dd-875a-8e92021c4e5c None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:12.436453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 502/983] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:12.441609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a396f-69f0-4458-a8b4-0c7adeb53291 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:12.441998 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a396f-69f0-4458-a8b4-0c7adeb53291 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:12.442183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a396f-69f0-4458-a8b4-0c7adeb53291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:12.460945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3e3a396f-69f0-4458-a8b4-0c7adeb53291 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:12.462529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3e3a396f-69f0-4458-a8b4-0c7adeb53291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:12.540073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 482/984] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:12.562404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad40a5f-e48e-41dd-875a-8e92021c4e5c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:12.620510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:12.647468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fbf88-9fe6-415c-a008-9aac603ae37b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:12.647774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fbf88-9fe6-415c-a008-9aac603ae37b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:12.648044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fbf88-9fe6-415c-a008-9aac603ae37b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:12.649917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 483/985] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:12.656439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d761-7fa4-4f9c-9f23-a3385e0bca5e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:12.656859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d761-7fa4-4f9c-9f23-a3385e0bca5e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:12.657115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09d761-7fa4-4f9c-9f23-a3385e0bca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:12.678690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad40a5f-e48e-41dd-875a-8e92021c4e5c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:12.678910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7c09d761-7fa4-4f9c-9f23-a3385e0bca5e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:12.680076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7c09d761-7fa4-4f9c-9f23-a3385e0bca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:12.716603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:12.717336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:12.717626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:12.717907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:12.718562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:12.719978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:12.732941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:12.733979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:12.735911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 503/986] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:12.740447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:12.755606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 484/987] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:12.777388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d761-7fa4-4f9c-9f23-a3385e0bca5e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:12.790143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:12.853417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec8f43-d356-4454-9e18-3fa224ef89eb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:12.870615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:12.890407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:12.891102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:12.891384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:12.891657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:12.892371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:12.892684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:12.894023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:12.894965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09d761-7fa4-4f9c-9f23-a3385e0bca5e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:12.899657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 504/988] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:12.905229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:12.932217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:12.933008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:12.933288 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:12.933559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] PATH_INFO: `/v3/services/image` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:12.934209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:12.935583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:12.947991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:12.949029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:12.955142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 485/989] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 26 20:00:12 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:12.955959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.011727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0395a-6753-4fbe-bf40-ca647f5387b7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.032283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:13.055230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.055933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.056213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.056487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.057195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:13.057502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.058899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.065618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981096a-af80-4e2e-9029-7b1f00253e39 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.065768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 505/990] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:13.075256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.107025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.107871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.108164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.108446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.109180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:13.109495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.110942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.117495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 486/991] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:13.122593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.135197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:13.194063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30a2cd-4f01-428f-9be1-ea5c39191dab None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.228019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0342e8c-20a5-4ec1-9a35-6cf76f3875e5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.229489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.230148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.230428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.230701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.231692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] RBAC: Adding query filter params (interface=admin, service_id=776ea071560c404ebfe1158d7154886e, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:13.232005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.233361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.238668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 506/992] 10.222.0.48 () {56 vars in 1249 bytes} [Thu May 26 20:00:13 2022] GET /identity/v3/endpoints?service_id=776ea071560c404ebfe1158d7154886e&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:13.244568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.266816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f26d8f-076f-4555-946c-eed0b855925e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.267445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f26d8f-076f-4555-946c-eed0b855925e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.267745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f26d8f-076f-4555-946c-eed0b855925e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.268004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f26d8f-076f-4555-946c-eed0b855925e None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.268713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f26d8f-076f-4555-946c-eed0b855925e None admin] RBAC: Adding query filter params (type=image) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:13.269018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f26d8f-076f-4555-946c-eed0b855925e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.270369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f26d8f-076f-4555-946c-eed0b855925e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.275443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 487/993] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:13.290042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f18b-aa24-473e-ac1d-fa10c4ecf638 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.290335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f18b-aa24-473e-ac1d-fa10c4ecf638 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.290615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303f18b-aa24-473e-ac1d-fa10c4ecf638 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.292237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 488/994] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:13.297840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73ab30-6e0d-49f5-8d75-8315f16a899a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.298178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73ab30-6e0d-49f5-8d75-8315f16a899a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.298404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73ab30-6e0d-49f5-8d75-8315f16a899a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.307289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:13.320610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ec73ab30-6e0d-49f5-8d75-8315f16a899a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:13.321825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ec73ab30-6e0d-49f5-8d75-8315f16a899a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:13.375382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c05e80-3d9f-487e-a67e-713aec35c14e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.392082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:13.401093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 489/995] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:13.420768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.421444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.421730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.422007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.422778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.423342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73ab30-6e0d-49f5-8d75-8315f16a899a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.424251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.432029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 507/996] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 20:00:13 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:00:13.538770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73ab30-6e0d-49f5-8d75-8315f16a899a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.571478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:13.577882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.578701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.579018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.579295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.579955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.581345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:13.594592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:13.595690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:13.596520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 490/997] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:13.604163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.716521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7154-43f0-49d5-96a5-9292d1e82412 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.750706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.751401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.751689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.751966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.752663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:13.752968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.754330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.764109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 508/998] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 20:00:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:13.765710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.870693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e5556-1495-4957-9f36-2d54918aae3c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:13.903627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:13.904297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:13.904586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:13.904863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:13.905572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:13.905882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:13.907274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:13.917296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 491/999] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 20:00:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:13.918527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:13.961086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:14.027942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343b72a-966d-4cc4-81ff-6a670b309c7e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:14.061677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deca789-c8bd-472f-aa44-168e6fefdfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:14.062332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca789-c8bd-472f-aa44-168e6fefdfeb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:14.062610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca789-c8bd-472f-aa44-168e6fefdfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:14.062903 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deca789-c8bd-472f-aa44-168e6fefdfeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:14.063683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deca789-c8bd-472f-aa44-168e6fefdfeb None admin] RBAC: Adding query filter params (interface=public, service_id=2193a22ff92641fbb2b04a03af0c56a3, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:14.063987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deca789-c8bd-472f-aa44-168e6fefdfeb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:14.065339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deca789-c8bd-472f-aa44-168e6fefdfeb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:14.070728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 509/1000] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 20:00:13 2022] GET /identity/v3/endpoints?service_id=2193a22ff92641fbb2b04a03af0c56a3&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:14.076019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:14.142303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:14.184974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597be310-d525-4f91-bdbc-7e0491890c53 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:14.218398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17edb180-b810-46f5-be11-4235390487da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:14.219108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edb180-b810-46f5-be11-4235390487da None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:14.219394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edb180-b810-46f5-be11-4235390487da None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:14.219668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17edb180-b810-46f5-be11-4235390487da None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:14.220342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edb180-b810-46f5-be11-4235390487da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:14.221697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17edb180-b810-46f5-be11-4235390487da None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:14.234941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 492/1001] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 20:00:14 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:00:15.501362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04177-95d6-4574-9b01-1db16b18e227 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:15.501918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04177-95d6-4574-9b01-1db16b18e227 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:15.501918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd04177-95d6-4574-9b01-1db16b18e227 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:15.503455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 510/1002] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:15.508504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0f76-e00c-4657-aab0-98d9fa48aa88 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:15.508884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0f76-e00c-4657-aab0-98d9fa48aa88 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:15.509066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b0f76-e00c-4657-aab0-98d9fa48aa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:15.526376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bb4b0f76-e00c-4657-aab0-98d9fa48aa88 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:15.527584 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bb4b0f76-e00c-4657-aab0-98d9fa48aa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:15.599221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 493/1003] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:15.617663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04177-95d6-4574-9b01-1db16b18e227 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:15.653819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ebef-db7f-42c1-97dc-f07cde511ed9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:15.654175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ebef-db7f-42c1-97dc-f07cde511ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:15.654393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8ebef-db7f-42c1-97dc-f07cde511ed9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:15.655956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 494/1004] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:15.660633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e013-77ce-43a4-b3e4-b51fe8651f6a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:15.661050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e013-77ce-43a4-b3e4-b51fe8651f6a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:15.661750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2e013-77ce-43a4-b3e4-b51fe8651f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:15.682392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-38c2e013-77ce-43a4-b3e4-b51fe8651f6a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:15.683600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-38c2e013-77ce-43a4-b3e4-b51fe8651f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:15.723126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd04177-95d6-4574-9b01-1db16b18e227 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:15.725249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:15.736670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:15.757997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 495/1005] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:15.760403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:15.761139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:15.761489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:15.761825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:15.762600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:15.764056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:15.778921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 511/1006] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 20:00:15 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:15.781953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2e013-77ce-43a4-b3e4-b51fe8651f6a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:15.893145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2e013-77ce-43a4-b3e4-b51fe8651f6a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:15.936140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:15.936970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:15.937254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:15.937528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:15.938186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:15.939613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:15.953306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:15.954335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 20:00:15.955278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:15.959203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 496/1007] 10.222.0.48 () {56 vars in 1126 bytes} [Thu May 26 20:00:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:15.961795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:16.063885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96a4fa-23b9-4aa0-9587-810cd2a1914f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:16.097415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:16.098081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:16.098363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:16.098663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:16.099390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:16.099692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:16.101050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:16.110514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 512/1008] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:16.112071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:16.159241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:16.217611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc891b2-19c2-40c1-b9f9-623792b23948 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:16.252859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1db82d-c118-46da-8146-a9a5114bebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:16.253560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1db82d-c118-46da-8146-a9a5114bebce None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:16.253847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1db82d-c118-46da-8146-a9a5114bebce None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:16.254136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1db82d-c118-46da-8146-a9a5114bebce None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:16.255462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1db82d-c118-46da-8146-a9a5114bebce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:16.255779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1db82d-c118-46da-8146-a9a5114bebce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:16.257193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1db82d-c118-46da-8146-a9a5114bebce None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:16.267842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 497/1009] 10.222.0.48 () {56 vars in 1122 bytes} [Thu May 26 20:00:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:16.269001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:16.298108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:16.375421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b44ec4-d05d-4d9e-b4ad-ebc152999850 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:16.408880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c49077-ef05-4d51-b627-0af04d398623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:16.409543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49077-ef05-4d51-b627-0af04d398623 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:16.409830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49077-ef05-4d51-b627-0af04d398623 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:16.410110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c49077-ef05-4d51-b627-0af04d398623 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:16.410875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c49077-ef05-4d51-b627-0af04d398623 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:16.412268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c49077-ef05-4d51-b627-0af04d398623 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:16.438868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 513/1010] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 20:00:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:00:16.447154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9057b-67b9-4b4a-917f-b6946371d607 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:16.447449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9057b-67b9-4b4a-917f-b6946371d607 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:16.447732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9057b-67b9-4b4a-917f-b6946371d607 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:16.449275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 498/1011] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:16.455308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823dec0-9671-4597-aa60-ea6ed527fa50 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:16.455602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823dec0-9671-4597-aa60-ea6ed527fa50 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:16.455882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5823dec0-9671-4597-aa60-ea6ed527fa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:16.474018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5823dec0-9671-4597-aa60-ea6ed527fa50 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:16.475275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5823dec0-9671-4597-aa60-ea6ed527fa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:16.557302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 514/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:16 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:16.580967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9057b-67b9-4b4a-917f-b6946371d607 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:16.706736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9057b-67b9-4b4a-917f-b6946371d607 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:16.716642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:16.743758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:16.744556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:16.744844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:16.745122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:16.745777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:16.747178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:16.759204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:16.760175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:16.761012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 499/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:16.766312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823dec0-9671-4597-aa60-ea6ed527fa50 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:16.780985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:16.871930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5823dec0-9671-4597-aa60-ea6ed527fa50 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:16.906438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:16.907063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:16.907352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:16.907631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:16.908334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:16.908641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:16.910013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:16.916014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 515/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 20:00:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:16.921667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:17.026271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0879fc-77dc-40f8-9b1c-b393690d41a2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:17.061214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79529dc-b42c-4bc2-b0d5-51ac0e093d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:17.061880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79529dc-b42c-4bc2-b0d5-51ac0e093d5f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:17.062160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79529dc-b42c-4bc2-b0d5-51ac0e093d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:17.062432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79529dc-b42c-4bc2-b0d5-51ac0e093d5f None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:17.063154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79529dc-b42c-4bc2-b0d5-51ac0e093d5f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:17.063459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79529dc-b42c-4bc2-b0d5-51ac0e093d5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:17.064800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79529dc-b42c-4bc2-b0d5-51ac0e093d5f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:17.070175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 500/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Thu May 26 20:00:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:17.075566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:17.151937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:17.176025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd972172-2f1f-4895-b70e-a7721c1c7d53 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:17.209533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91186a-0360-4fc0-9a97-65a6377c1b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:17.210185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91186a-0360-4fc0-9a97-65a6377c1b31 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:17.210462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91186a-0360-4fc0-9a97-65a6377c1b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:17.210730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91186a-0360-4fc0-9a97-65a6377c1b31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:17.211520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91186a-0360-4fc0-9a97-65a6377c1b31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:17.212866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91186a-0360-4fc0-9a97-65a6377c1b31 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:17.238874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 516/1016] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 20:00:17 2022] POST /identity/v3/endpoints => generated 334 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:18.026610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1f215-bd5b-465c-b230-48785876eb1d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.027131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1f215-bd5b-465c-b230-48785876eb1d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.027131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a1f215-bd5b-465c-b230-48785876eb1d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.028531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 501/1017] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:18.033652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee7a94-23a2-4702-86d6-f7175328668f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.034097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee7a94-23a2-4702-86d6-f7175328668f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.034243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee7a94-23a2-4702-86d6-f7175328668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.051184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-99ee7a94-23a2-4702-86d6-f7175328668f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:18.053031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-99ee7a94-23a2-4702-86d6-f7175328668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:18.134881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 517/1018] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:18.155637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1f215-bd5b-465c-b230-48785876eb1d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:18.203471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:18.269689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a1f215-bd5b-465c-b230-48785876eb1d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:18.303940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:18.304651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.304934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.305207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.305847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:18.307234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:18.319064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:18.320060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:18.320906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:18.322952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 502/1019] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 26 20:00:18 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:18.326269 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee7a94-23a2-4702-86d6-f7175328668f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:18.386717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:18.430284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee7a94-23a2-4702-86d6-f7175328668f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:18.466682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:18.467380 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.467664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.467939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.468640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] RBAC: Adding query filter params (name=image) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:18.468943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:18.470306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:18.480393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 518/1020] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:18.481557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:18.591014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:18.594209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa1290-72b2-4d68-8a3b-52bba43181a6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:18.637913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a52d6-afe9-4ada-8710-df2a8047edfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:18.638587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a52d6-afe9-4ada-8710-df2a8047edfe None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.638903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a52d6-afe9-4ada-8710-df2a8047edfe None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.639187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a52d6-afe9-4ada-8710-df2a8047edfe None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.639896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a52d6-afe9-4ada-8710-df2a8047edfe None admin] RBAC: Adding query filter params (type=image) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:18.640205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a52d6-afe9-4ada-8710-df2a8047edfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:18.641564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a52d6-afe9-4ada-8710-df2a8047edfe None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:18.651716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 503/1021] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:18.653259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:18.722111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bf95-1f4f-4df3-96eb-ff56bfedc6a4 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.722454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bf95-1f4f-4df3-96eb-ff56bfedc6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.722675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a82bf95-1f4f-4df3-96eb-ff56bfedc6a4 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.724761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 504/1022] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:18.729404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442c49-322b-458b-8b15-09258e8e31eb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.729694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442c49-322b-458b-8b15-09258e8e31eb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.729974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442c49-322b-458b-8b15-09258e8e31eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.750426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9b442c49-322b-458b-8b15-09258e8e31eb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:18.751631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9b442c49-322b-458b-8b15-09258e8e31eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:18.756054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bc178-f60b-4aed-9ef3-15aecd9b4dec None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:18.781292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:18.794573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:18.795264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.795549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.795823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.796600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] RBAC: Adding query filter params (interface=public, service_id=62fa9565d68b4d0b980dd5031a422192, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:18.796911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:18.798266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:18.804048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 519/1023] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 20:00:18 2022] GET /identity/v3/endpoints?service_id=62fa9565d68b4d0b980dd5031a422192&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:18.809350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:18.829082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 505/1024] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:18.853374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442c49-322b-458b-8b15-09258e8e31eb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:18.916733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f7724-c9f6-4c7d-a3fd-562d1701beab None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:18.952242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:18.952906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:18.953191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:18.953468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:18.954145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:18.955530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:18.957017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:18.962670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 520/1025] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 20:00:18 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:00:18.968597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442c49-322b-458b-8b15-09258e8e31eb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:19.008871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee9c29-463c-4fa3-b397-48091c2049a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:19.009682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9c29-463c-4fa3-b397-48091c2049a9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:19.009965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9c29-463c-4fa3-b397-48091c2049a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:19.010243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee9c29-463c-4fa3-b397-48091c2049a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:19.011469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee9c29-463c-4fa3-b397-48091c2049a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:19.012911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee9c29-463c-4fa3-b397-48091c2049a9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:19.014777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 506/1026] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:19.022079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:19.080511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:19.135767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990dd51-22aa-4c31-82b5-53b8b771f044 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:19.170577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88972ba-089a-474d-b85b-74794233595d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:19.171271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88972ba-089a-474d-b85b-74794233595d None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:19.171551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88972ba-089a-474d-b85b-74794233595d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:19.171820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88972ba-089a-474d-b85b-74794233595d None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:19.172537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88972ba-089a-474d-b85b-74794233595d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:19.173947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88972ba-089a-474d-b85b-74794233595d None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:19.201437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 521/1027] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 20:00:19 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:19.550908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1db7-7541-4dd1-ac1e-0bb4df1d55aa None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:19.551935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1db7-7541-4dd1-ac1e-0bb4df1d55aa None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:19.551935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e1db7-7541-4dd1-ac1e-0bb4df1d55aa None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:19.553552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 507/1028] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:19.558969 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4461-aeef-4334-ad59-17d0029f97c7 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:19.559267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4461-aeef-4334-ad59-17d0029f97c7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:19.559557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e4461-aeef-4334-ad59-17d0029f97c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:19.577135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b69e4461-aeef-4334-ad59-17d0029f97c7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:19.578316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b69e4461-aeef-4334-ad59-17d0029f97c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:19.652996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 522/1029] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:19.676213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1db7-7541-4dd1-ac1e-0bb4df1d55aa None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:19.781024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e1db7-7541-4dd1-ac1e-0bb4df1d55aa None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:19.815818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:19.816553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:19.816833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:19.817148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:19.827480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:19.835848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:19.836756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:19.837605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:19.839141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 508/1030] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 20:00:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:19.843116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4461-aeef-4334-ad59-17d0029f97c7 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:19.875894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:19.947402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e4461-aeef-4334-ad59-17d0029f97c7 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:19.980745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:19.981413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:19.981690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:19.981960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:19.982693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:19.983026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:19.984375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:20.001052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 523/1031] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 20:00:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:20.002710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:20.029149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:20.109189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef51937-0111-41e2-ba47-f7ec7b5a2ad3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:20.143309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:20.144109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:20.144398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:20.144676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:20.155859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:20.157298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:20.174952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:20.175846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:20.176756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:20.176756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:20.176756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:20.176756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:20.176756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 509/1032] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:20.181939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:20.276191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:20.284157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ff802-0d96-42e8-8be5-1244cc344064 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:20.317217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:20.317877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:20.318164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:20.318705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:20.319461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:20.319769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:20.321130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:20.337919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 524/1033] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:20.339390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:20.417440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:20.443930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9187a1dc-48eb-40e1-bae0-f61e53866d01 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:20.477576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:20.478374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:20.478659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:20.478964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:20.486529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:20.487997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:00:20.501955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:20.503569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:20.505047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 510/1034] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 20:00:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:20.509616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:20.611522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f65d2-1268-47eb-8290-73a7fffeca95 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:20.649346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:20.650022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:20.650307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:20.650584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:20.651449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:20.651761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:20.653192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:20.674971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 525/1035] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 20:00:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:20.676435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:20.781955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77974a99-423b-4e74-9547-084bb57a9d03 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:20.816538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf5544-02d5-42eb-8d8c-62d718c0f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:20.817768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf5544-02d5-42eb-8d8c-62d718c0f385 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:20.818054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf5544-02d5-42eb-8d8c-62d718c0f385 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:20.818331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf5544-02d5-42eb-8d8c-62d718c0f385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:20.821559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:20.889509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf5544-02d5-42eb-8d8c-62d718c0f385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:20.890983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf5544-02d5-42eb-8d8c-62d718c0f385 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:20.996991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 511/1036] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:20 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 20:00:20.998970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.016003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.103260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a8abe-5c65-4bb5-b6a7-140c7a6ecdf4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.137701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.138497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.138783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.139091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.149280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.150730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:21.168800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:21.169726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:21.170611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:21.170611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:21.170611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:21.170611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:21.172979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94171-f39c-47f1-967a-fd01a252f794 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.173275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94171-f39c-47f1-967a-fd01a252f794 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.173557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94171-f39c-47f1-967a-fd01a252f794 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.174582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 526/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:21.175298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 512/1038] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:21.175693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.180894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6116e-2fb5-49e2-955d-38ce7b689c85 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.181183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6116e-2fb5-49e2-955d-38ce7b689c85 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.181463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d6116e-2fb5-49e2-955d-38ce7b689c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.198032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a0d6116e-2fb5-49e2-955d-38ce7b689c85 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:21.199277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a0d6116e-2fb5-49e2-955d-38ce7b689c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:21.228047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.244571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.282426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 513/1039] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:21.292217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15400070-3c77-4d5f-a4f4-2b3fb12a77c5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.305879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6116e-2fb5-49e2-955d-38ce7b689c85 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.331345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.332579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.333486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.334145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.335202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:21.335927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.338184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.354591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 527/1040] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:21.360168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.413409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d6116e-2fb5-49e2-955d-38ce7b689c85 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.450483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9f833-99e2-4b73-b840-2748bf8cd70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.451311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f833-99e2-4b73-b840-2748bf8cd70c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.451602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f833-99e2-4b73-b840-2748bf8cd70c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.451879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9f833-99e2-4b73-b840-2748bf8cd70c None admin] PATH_INFO: `/v3/services/image` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.452538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f833-99e2-4b73-b840-2748bf8cd70c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.453896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9f833-99e2-4b73-b840-2748bf8cd70c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c1a9f833-99e2-4b73-b840-2748bf8cd70c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:21.465425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:21.466413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 20:00:21.467535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:21.468281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfd461-b07a-4b4c-9de5-ab7724188e6f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.468355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 514/1041] 10.222.0.48 () {56 vars in 1105 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:21.468355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6063d-e627-46ba-b5ed-299fa2ffbe4b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.468355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6063d-e627-46ba-b5ed-299fa2ffbe4b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.468536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6063d-e627-46ba-b5ed-299fa2ffbe4b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.470254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 515/1042] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:21.472468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6063d-e627-46ba-b5ed-299fa2ffbe4b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.493139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.501455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.504076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96de23-2348-4378-9901-8bc6e1057292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.504867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96de23-2348-4378-9901-8bc6e1057292 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.505145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96de23-2348-4378-9901-8bc6e1057292 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.505435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96de23-2348-4378-9901-8bc6e1057292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.512024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96de23-2348-4378-9901-8bc6e1057292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.513458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96de23-2348-4378-9901-8bc6e1057292 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-be96de23-2348-4378-9901-8bc6e1057292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:00:21.527897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:21.528818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:21.529812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 528/1043] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:21.530292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcd31-532e-40dd-905a-0edc3ea7a92e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.530499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcd31-532e-40dd-905a-0edc3ea7a92e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.530793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effdcd31-532e-40dd-905a-0edc3ea7a92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.547366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-effdcd31-532e-40dd-905a-0edc3ea7a92e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:21.548492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-effdcd31-532e-40dd-905a-0edc3ea7a92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:21.580372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6063d-e627-46ba-b5ed-299fa2ffbe4b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.615802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.616466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.616754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.617030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.617733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] RBAC: Adding query filter params (name=image) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:21.618039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.619438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.621057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 529/1044] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:21.621679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdcd31-532e-40dd-905a-0edc3ea7a92e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.635355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 516/1045] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:21.641038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.724714 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effdcd31-532e-40dd-905a-0edc3ea7a92e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.731011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.738821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.740777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59bdb8-15d9-4f9c-bfbf-ba38ff0c256a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.758356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.759043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.759331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.759607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.760390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:21.760693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.762110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.773874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 530/1046] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:21.774727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.775102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.775771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.776061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.776342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.777051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] RBAC: Adding query filter params (type=image) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:21.777361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.779113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.789306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 517/1047] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:21.789306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.875679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926044ff-b713-40a1-acf6-d26b327021e2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.892635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e219f0d-f798-4982-afe7-e46ca6144b3b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:21.912062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.912859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.913143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.913423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.914603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.916085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.917701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 531/1048] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:21.918439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.927231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:21.927890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:21.928171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:21.928448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:21.929281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] RBAC: Adding query filter params (role.id=89bc9e01f2f145ddb932bbea5bc944b7, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=e8a59979309a45f98c0b4fb27af83c6e) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:21.929589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:21.931044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:21.936533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 518/1049] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:21 2022] GET /identity/v3/role_assignments?user.id=e8a59979309a45f98c0b4fb27af83c6e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=89bc9e01f2f145ddb932bbea5bc944b7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:21.937283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:21.962550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:21.967921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:22.031247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b0da8-e230-418d-af99-f2f244e8e6cf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:22.055493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c805a3-5f24-4844-8041-ef64f233fd22 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:22.067902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ab9cd-232d-4586-85a8-3d91debd4145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:22.068834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ab9cd-232d-4586-85a8-3d91debd4145 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:22.069121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ab9cd-232d-4586-85a8-3d91debd4145 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:22.069397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ab9cd-232d-4586-85a8-3d91debd4145 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:22.070151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ab9cd-232d-4586-85a8-3d91debd4145 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:22.071576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ab9cd-232d-4586-85a8-3d91debd4145 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:22.102906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 532/1050] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 20:00:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:22.113128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f63b0c-a967-4be8-abcb-12a329fce3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:22.113852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63b0c-a967-4be8-abcb-12a329fce3d6 None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:22.114139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63b0c-a967-4be8-abcb-12a329fce3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:22.114419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f63b0c-a967-4be8-abcb-12a329fce3d6 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:22.115184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f63b0c-a967-4be8-abcb-12a329fce3d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:22.116667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f63b0c-a967-4be8-abcb-12a329fce3d6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:22.146971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 519/1051] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 20:00:21 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:24.163028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076d14-05ae-49bb-a944-2efd5dd8f3f5 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.163562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076d14-05ae-49bb-a944-2efd5dd8f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.163668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61076d14-05ae-49bb-a944-2efd5dd8f3f5 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.166887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 533/1052] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:24.170867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e578-5cec-4520-a977-2d926ed2c78d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.171413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e578-5cec-4520-a977-2d926ed2c78d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.171413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384e578-5cec-4520-a977-2d926ed2c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.190052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a384e578-5cec-4520-a977-2d926ed2c78d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:24.191325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a384e578-5cec-4520-a977-2d926ed2c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:24.265021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 520/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:24.288499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61076d14-05ae-49bb-a944-2efd5dd8f3f5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:24.372810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda5f9-b58b-4e8b-b58e-754579ea09bd None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.373164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda5f9-b58b-4e8b-b58e-754579ea09bd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.373389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cda5f9-b58b-4e8b-b58e-754579ea09bd None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.374768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 521/1054] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:24.380316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f3431-b607-4e87-a234-3021d3262817 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.380612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f3431-b607-4e87-a234-3021d3262817 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.380896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f3431-b607-4e87-a234-3021d3262817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.385934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:24.398939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ed5f3431-b607-4e87-a234-3021d3262817 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:24.400158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ed5f3431-b607-4e87-a234-3021d3262817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:24.400753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:24.407395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61076d14-05ae-49bb-a944-2efd5dd8f3f5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:24.446931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972691c2-e8f7-4f51-9f34-56b4c8f11658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:24.447668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972691c2-e8f7-4f51-9f34-56b4c8f11658 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.447955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972691c2-e8f7-4f51-9f34-56b4c8f11658 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.448235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972691c2-e8f7-4f51-9f34-56b4c8f11658 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.458578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972691c2-e8f7-4f51-9f34-56b4c8f11658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-972691c2-e8f7-4f51-9f34-56b4c8f11658 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:24.466883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:24.467977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 534/1055] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 20:00:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:24.469323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1470f-941d-4445-a435-34a3a292b3c1 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.470073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1470f-941d-4445-a435-34a3a292b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.470073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f1470f-941d-4445-a435-34a3a292b3c1 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.471232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 535/1056] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:24.474879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 522/1057] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:24.476309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1470f-941d-4445-a435-34a3a292b3c1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:24.476887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6f3-72b1-4d9f-8bcf-5bab2601f69a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.477181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6f3-72b1-4d9f-8bcf-5bab2601f69a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.477460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d9f6f3-72b1-4d9f-8bcf-5bab2601f69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.496260 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-15d9f6f3-72b1-4d9f-8bcf-5bab2601f69a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:24.497445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-15d9f6f3-72b1-4d9f-8bcf-5bab2601f69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:24.563753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 523/1058] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:24.564647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9f6f3-72b1-4d9f-8bcf-5bab2601f69a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:24.587810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f1470f-941d-4445-a435-34a3a292b3c1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:24.624950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:24.625620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.625914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.626175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.626942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:24.627055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:24.627246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:24.628617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:24.637489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 536/1059] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 20:00:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:24.638483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:24.660606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:24.668387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d9f6f3-72b1-4d9f-8bcf-5bab2601f69a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:24.702203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:24.702791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.703109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.703392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.738590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f47e8-abb1-4cfa-9f73-dc15fc7bd818 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:24.771026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:24.771520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50623752-e231-475a-833d-a7607a64375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:24.772315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623752-e231-475a-833d-a7607a64375d None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.772480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:24.772600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623752-e231-475a-833d-a7607a64375d None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.772875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50623752-e231-475a-833d-a7607a64375d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.783238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50623752-e231-475a-833d-a7607a64375d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-50623752-e231-475a-833d-a7607a64375d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:24.792712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:24.793825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 537/1060] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:00:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:24.794692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50623752-e231-475a-833d-a7607a64375d None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:24.838209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:24.876407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:24.878131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 524/1061] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:24.880273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:24.897307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50623752-e231-475a-833d-a7607a64375d None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:24.930079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:24.930899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:24.931194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:24.931471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:24.942677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:24.944478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:24.961954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:24.963062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:24.964002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:24.964002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:24.964002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:24.964002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:24.964002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 538/1062] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:24.964002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:24.980299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4cc68-92cc-4f5f-a24d-81eca70d5154 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.014514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.015210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.015493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.015770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.016516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:25.016822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.018185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.027037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 525/1063] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:00:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:25.027813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.053766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.061455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cab7e0-e6c6-4c82-9801-808b69d00fe6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.090549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.096173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.096960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.097242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.097515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.107982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.109428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:25.126324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:25.127259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:25.128167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:25.128167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:25.128167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:25.128167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:25.128167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 539/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:25.128455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c174de-9893-432a-8601-708bfe424eeb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.128530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.161999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.162662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.162984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.163281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.163979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:25.164284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.165640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.177191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 526/1065] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:25.177972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.232289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00222f61-679d-45a0-a804-5a303ae34019 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.261108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.266712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.267610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.267889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.268166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] PATH_INFO: `/v3/users/5fd7050c1a6146d79cf71893a3f4662a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.276389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bc3ee-9081-4043-96c6-4e4986ff0f90 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.281203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] RBAC: Authorizing `identity:get_user(user_id=5fd7050c1a6146d79cf71893a3f4662a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.282654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.284372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 540/1066] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/users/5fd7050c1a6146d79cf71893a3f4662a => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:25.285136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.309612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.310341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.310627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.310927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.311639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:25.311943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.313289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.325206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 527/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:25.325851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.329831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.400591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c011be-2e49-4b1c-8975-8439279294e6 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.439078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.439927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.440219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.440318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6fd59-d20d-471f-8c5a-ec4c183261da None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.440498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.452806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.454287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:00:25.470144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:25.471213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:25.472194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 541/1068] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:25.477458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.487837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.488424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.489250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.489536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.507040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.571494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.572957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.601687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53122be5-0771-4019-9587-9904c281b7cb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.604196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.640452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.641132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.641420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.641699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.642535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:25.642878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.644371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.662076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 542/1069] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:25.667736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.691491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 528/1070] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:25.697345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.740519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.764072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77addd-3db5-44f5-8e0e-3c3133da98bb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.793925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01a85d-dba8-400b-aee7-9554304c6623 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.797691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.798474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.798754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.799066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.809333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.810763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:25.828285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:25.829263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:25.830156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:25.830156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:25.830156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:25.830156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:25.830389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.830389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.830536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 543/1071] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:25.830604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.830604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.831878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] RBAC: Authorizing `identity:get_project(project_id=58738a4b584e408ca8e74fb0406bb2f2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.833330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.834941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.835250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 529/1072] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:25.840950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:25.849765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.933448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dbea-c9b8-4d9e-853d-1cca65e475c1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.938518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674a6d3-deb6-4d59-9563-87ac4635d52d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:25.952116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:25.968187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.968844 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.969120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.969388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.970099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:25.970400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.971795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.973698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:25.974349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:25.974638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:25.974941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:25.975768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=58738a4b584e408ca8e74fb0406bb2f2, user.id=5fd7050c1a6146d79cf71893a3f4662a) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:25.976080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:25.977475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:25.982936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 530/1073] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/role_assignments?user.id=5fd7050c1a6146d79cf71893a3f4662a&scope.project.id=58738a4b584e408ca8e74fb0406bb2f2&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:25.983754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 544/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:25.989979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:26.095881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df2182-8579-4b41-87ee-012a70a605bf None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:26.131134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:26.131950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:26.132239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:26.132517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:26.139977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:26.141446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:00:26.157078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:26.158034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:26.158945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:26.162926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 531/1075] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:26.164861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:26.233540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:26.264769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f386a-ede4-4551-bf7f-6959a7163ae4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:26.302684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d6fe-6513-4ca1-baf2-208761ab2045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:26.303380 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d6fe-6513-4ca1-baf2-208761ab2045 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:26.303665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d6fe-6513-4ca1-baf2-208761ab2045 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:26.303942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d6fe-6513-4ca1-baf2-208761ab2045 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:26.304728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d6fe-6513-4ca1-baf2-208761ab2045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:26.305038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d6fe-6513-4ca1-baf2-208761ab2045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:26.306470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d6fe-6513-4ca1-baf2-208761ab2045 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:26.318765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 545/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:00:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:26.324530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:26.359479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:26.423233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6231f3-2a9e-443d-8710-58cf6200aa97 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:26.457518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02247a6-c9c6-4ed5-a492-b4041ec3e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:26.458927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02247a6-c9c6-4ed5-a492-b4041ec3e108 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:26.459065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02247a6-c9c6-4ed5-a492-b4041ec3e108 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:26.460392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02247a6-c9c6-4ed5-a492-b4041ec3e108 None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/e8a59979309a45f98c0b4fb27af83c6e/roles/89bc9e01f2f145ddb932bbea5bc944b7` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:26.461444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02247a6-c9c6-4ed5-a492-b4041ec3e108 None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=e8a59979309a45f98c0b4fb27af83c6e, role_id=89bc9e01f2f145ddb932bbea5bc944b7)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:26.462882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02247a6-c9c6-4ed5-a492-b4041ec3e108 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:26.475400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 532/1077] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:00:26 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/e8a59979309a45f98c0b4fb27af83c6e/roles/89bc9e01f2f145ddb932bbea5bc944b7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:00:28.160015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c08f-755f-41fd-ba47-c12209437e79 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.167629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c08f-755f-41fd-ba47-c12209437e79 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.167629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c08f-755f-41fd-ba47-c12209437e79 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.167629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 546/1078] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:28.167892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea648fc-7946-4b8a-a605-81fe6de23498 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.168251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea648fc-7946-4b8a-a605-81fe6de23498 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.168348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea648fc-7946-4b8a-a605-81fe6de23498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.185458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9ea648fc-7946-4b8a-a605-81fe6de23498 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:28.186648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9ea648fc-7946-4b8a-a605-81fe6de23498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:28.253438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 533/1079] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:28.276028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c08f-755f-41fd-ba47-c12209437e79 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:28.375727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c08f-755f-41fd-ba47-c12209437e79 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:28.404233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:28.409901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:28.411327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.411565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.411841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.421825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:28.429590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:28.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:28.431821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 547/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:28.436917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea648fc-7946-4b8a-a605-81fe6de23498 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:28.473055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:28.552975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea648fc-7946-4b8a-a605-81fe6de23498 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:28.586305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1033378-3739-40c7-95e0-f58c2f474284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:28.586999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033378-3739-40c7-95e0-f58c2f474284 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.587288 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033378-3739-40c7-95e0-f58c2f474284 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.587563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1033378-3739-40c7-95e0-f58c2f474284 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.588302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033378-3739-40c7-95e0-f58c2f474284 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:28.588606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033378-3739-40c7-95e0-f58c2f474284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:28.589954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1033378-3739-40c7-95e0-f58c2f474284 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:28.597851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 534/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:28.604117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:28.654313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914dcd7-6d98-43ca-80ef-a23d63562f99 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.654611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914dcd7-6d98-43ca-80ef-a23d63562f99 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.654918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914dcd7-6d98-43ca-80ef-a23d63562f99 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.656296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 535/1082] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:00:28.661698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637c10a-1fcf-447f-bb71-7620f6c85332 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.661928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637c10a-1fcf-447f-bb71-7620f6c85332 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.662206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637c10a-1fcf-447f-bb71-7620f6c85332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.678773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6637c10a-1fcf-447f-bb71-7620f6c85332 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:28.679975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6637c10a-1fcf-447f-bb71-7620f6c85332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:28.707795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dae57e-afa4-48cf-b25d-de10646a1790 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:28.741906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:28.742767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.743078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.743354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] PATH_INFO: `/v3/users/5fd7050c1a6146d79cf71893a3f4662a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.744520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] RBAC: Authorizing `identity:get_user(user_id=5fd7050c1a6146d79cf71893a3f4662a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:28.745666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 536/1083] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:28.746021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:28.750183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 548/1084] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:28 2022] GET /identity/v3/users/5fd7050c1a6146d79cf71893a3f4662a => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:28.753243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637c10a-1fcf-447f-bb71-7620f6c85332 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:28.768805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:28.771204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:28.828339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:28.853454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637c10a-1fcf-447f-bb71-7620f6c85332 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:28.869618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53f005-cf14-4a66-99a8-ee0f6d8d0fcd None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:28.886691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:28.887579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.887863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.888138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.889308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] RBAC: Authorizing `identity:get_project(project_id=58738a4b584e408ca8e74fb0406bb2f2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:28.890725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:28.892499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 537/1085] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:28 2022] GET /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:28.898182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:28.901932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:28.902750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:28.903065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:28.903341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:28.915756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:28.923976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:28.925084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:28.926864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 549/1086] 10.222.0.48 () {56 vars in 1120 bytes} [Thu May 26 20:00:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:28.931524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:28.986010 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:29.001578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b44345-73a2-46fa-be7f-08127bacf211 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:29.036440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:29.037021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf5de8-ba25-4b86-8e5b-21d6216167c4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:29.037330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:29.037614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:29.037891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2/users/5fd7050c1a6146d79cf71893a3f4662a/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:29.040024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=58738a4b584e408ca8e74fb0406bb2f2, user_id=5fd7050c1a6146d79cf71893a3f4662a, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:29.041465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:29.054193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 538/1087] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:00:28 2022] PUT /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2/users/5fd7050c1a6146d79cf71893a3f4662a/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:00:29.056700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:29.071721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:29.072415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:29.072698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:29.072971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:29.073729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:29.074034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:29.075481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:29.085244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 550/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 20:00:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:29.091249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:29.196545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7386fc-6c9a-4f8f-a240-6ddf4545fef5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:29.239224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:29.240037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:29.240314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:29.240587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:29.251185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:29.252625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:29.260446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:29.273228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:29.274154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:29.275078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:29.275078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:29.275078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:29.275078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:29.275078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 539/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:29.280092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:29.386193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1275e-5cf3-4100-b537-cabbe6f372b8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:29.418697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:29.419374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:29.419655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:29.419926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:29.420632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:29.420931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:29.422283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:29.435351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 551/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:29.440863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:29.548252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7cb870-23c2-4b65-8817-9a8595da4cb4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:29.582021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:29.582833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:29.583146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:29.583426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:29.590563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:29.592035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:00:29.606926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:29.607915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:29.608931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 540/1091] 10.222.0.48 () {56 vars in 1093 bytes} [Thu May 26 20:00:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:29.614551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:29.657744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:29.712614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff172461-5a1a-4ac2-9480-2c12339700fb None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:29.745323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:29.745982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:29.746351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:29.746628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:29.747487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:29.747788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:29.749202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:29.765693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 552/1092] 10.222.0.48 () {56 vars in 1133 bytes} [Thu May 26 20:00:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:29.771808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:29.829933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:29.870969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b43f7-2229-40a5-b4ad-30d2702229d0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:29.903752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:29.904390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:29.904694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:29.904968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:29.970153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:29.971630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:30.027511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:30.072766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 541/1093] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:30.078505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:30.172599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:30.175893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690bd9a-801e-4424-a6e8-cc710bfee5c7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:30.209291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:30.210077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:30.210356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:30.210626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:30.220393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:30.221829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:00:30.240047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:30.241129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:30.242041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:00:30.242041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:00:30.242041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:00:30.242041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:30.242041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 553/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:30.247019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:30.344605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed121f-98a5-4bf3-a8e8-3df05d5353d8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:30.378003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:30.378659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:30.378985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:30.379265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:30.379980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:30.380287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:30.381641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:30.392608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 542/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:30.398063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:30.494798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a4a7-ccea-4c37-87e0-4b380b75eeb8 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:30.527588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:30.528372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:30.528648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:30.528918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:30.536341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:30.537768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:00:30.551375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:30.552475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:30.553419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 554/1096] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:00:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:00:30.558275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:30.577678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:30.670143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d3b917-46ae-430e-8869-c79a77beadc8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:30.702550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70218b9c-75a8-4655-a1a7-aa32e0024ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:30.703242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218b9c-75a8-4655-a1a7-aa32e0024ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:30.703531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218b9c-75a8-4655-a1a7-aa32e0024ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:30.703808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70218b9c-75a8-4655-a1a7-aa32e0024ac2 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:30.704592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70218b9c-75a8-4655-a1a7-aa32e0024ac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:30.704903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70218b9c-75a8-4655-a1a7-aa32e0024ac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:30.706354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70218b9c-75a8-4655-a1a7-aa32e0024ac2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:30.719613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 543/1097] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:30.726046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:30.741088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:30.829119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8f844-76f9-4209-afe7-1ba3c427b933 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:30.864103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ac635-2b81-4d7e-8cbf-31a3efed6457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:30.864747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ac635-2b81-4d7e-8cbf-31a3efed6457 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:30.865028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ac635-2b81-4d7e-8cbf-31a3efed6457 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:30.865301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ac635-2b81-4d7e-8cbf-31a3efed6457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:30.866117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ac635-2b81-4d7e-8cbf-31a3efed6457 None admin] RBAC: Adding query filter params (role.id=89bc9e01f2f145ddb932bbea5bc944b7, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=e8a59979309a45f98c0b4fb27af83c6e) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:30.866423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ac635-2b81-4d7e-8cbf-31a3efed6457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:30.867878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ac635-2b81-4d7e-8cbf-31a3efed6457 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:30.873565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 555/1098] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:30 2022] GET /identity/v3/role_assignments?user.id=e8a59979309a45f98c0b4fb27af83c6e&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=89bc9e01f2f145ddb932bbea5bc944b7 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:31.247736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641b972-220c-4ffc-b4ca-52b32cdf05f5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:31.248284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641b972-220c-4ffc-b4ca-52b32cdf05f5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:31.248284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641b972-220c-4ffc-b4ca-52b32cdf05f5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:31.249636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 544/1099] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:31.255641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bb6b-511d-4e4d-8ce3-9dff29dcdd66 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:31.255935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bb6b-511d-4e4d-8ce3-9dff29dcdd66 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:31.256223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8bb6b-511d-4e4d-8ce3-9dff29dcdd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:31.272879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a5e8bb6b-511d-4e4d-8ce3-9dff29dcdd66 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:31.274064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a5e8bb6b-511d-4e4d-8ce3-9dff29dcdd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:31.344073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 556/1100] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:31.367265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641b972-220c-4ffc-b4ca-52b32cdf05f5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:31.448874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:31.479038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641b972-220c-4ffc-b4ca-52b32cdf05f5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:31.514356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:31.515118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:31.515406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:31.515686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:31.526067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:31.534004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:31.535174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:31.536231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 545/1101] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:31.541534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bb6b-511d-4e4d-8ce3-9dff29dcdd66 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:31.549882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:31.643939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8bb6b-511d-4e4d-8ce3-9dff29dcdd66 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:31.678972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:31.679645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:31.679925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:31.680200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:31.680942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:31.681248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:31.682612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:31.691387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 557/1102] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:31.697344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:31.796445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63a352-fc6e-4a32-bc59-5850e2af69d4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:31.828866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:31.829725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:31.830006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:31.830278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] PATH_INFO: `/v3/users/5fd7050c1a6146d79cf71893a3f4662a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:31.831460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] RBAC: Authorizing `identity:get_user(user_id=5fd7050c1a6146d79cf71893a3f4662a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:31.832915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:31.834698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 546/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:31 2022] GET /identity/v3/users/5fd7050c1a6146d79cf71893a3f4662a => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:31.840485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:31.904332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:31.937398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d98ed-eaf5-4b1e-a9a6-293de91ad7b1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:31.969102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:31.969737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:31.970021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:31.970298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:32.034500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:32.036667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:32.104019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:32.138138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 558/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:32.144167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:32.153843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:32.243218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e22f18-a60a-4c75-9a73-013ee34b3d74 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:32.275823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede2db9-d57c-44c7-95ce-528a3bbf7c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:32.276683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2db9-d57c-44c7-95ce-528a3bbf7c0e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:32.276970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2db9-d57c-44c7-95ce-528a3bbf7c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:32.277264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede2db9-d57c-44c7-95ce-528a3bbf7c0e None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:32.278405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede2db9-d57c-44c7-95ce-528a3bbf7c0e None admin] RBAC: Authorizing `identity:get_project(project_id=58738a4b584e408ca8e74fb0406bb2f2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:32.279846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede2db9-d57c-44c7-95ce-528a3bbf7c0e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:32.281518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 547/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:32 2022] GET /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:32.288066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:32.385487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48789b7-94c9-40b5-a904-35afc4ef96b5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:32.418006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb870d19-cbac-449d-80fc-b9647efa7583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:32.418646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870d19-cbac-449d-80fc-b9647efa7583 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:32.418957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870d19-cbac-449d-80fc-b9647efa7583 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:32.419236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb870d19-cbac-449d-80fc-b9647efa7583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:32.420052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb870d19-cbac-449d-80fc-b9647efa7583 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=58738a4b584e408ca8e74fb0406bb2f2, user.id=5fd7050c1a6146d79cf71893a3f4662a) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:32.420363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb870d19-cbac-449d-80fc-b9647efa7583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:32.421784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb870d19-cbac-449d-80fc-b9647efa7583 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:32.427409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 559/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:32 2022] GET /identity/v3/role_assignments?user.id=5fd7050c1a6146d79cf71893a3f4662a&scope.project.id=58738a4b584e408ca8e74fb0406bb2f2&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:34.628680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9e9bf-d708-4529-a7be-85027dbb855e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:34.629812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9e9bf-d708-4529-a7be-85027dbb855e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:34.629812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9e9bf-d708-4529-a7be-85027dbb855e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:34.631218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 548/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:34.636577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a968-2903-49f6-9fd6-f94caae42f15 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:34.636981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a968-2903-49f6-9fd6-f94caae42f15 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:34.637143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339a968-2903-49f6-9fd6-f94caae42f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:34.653463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3339a968-2903-49f6-9fd6-f94caae42f15 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:34.654670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3339a968-2903-49f6-9fd6-f94caae42f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:34.680486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:34.720127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 560/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:34.745452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9e9bf-d708-4529-a7be-85027dbb855e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:34.819927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:34.844563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9e9bf-d708-4529-a7be-85027dbb855e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:34.877712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12432a00-461f-4403-9a2b-e0ea0f831483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:34.878493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432a00-461f-4403-9a2b-e0ea0f831483 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:34.878824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432a00-461f-4403-9a2b-e0ea0f831483 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:34.879115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12432a00-461f-4403-9a2b-e0ea0f831483 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:34.880279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12432a00-461f-4403-9a2b-e0ea0f831483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:34.881697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12432a00-461f-4403-9a2b-e0ea0f831483 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:34.883332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 549/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:34.889008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339a968-2903-49f6-9fd6-f94caae42f15 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:34.983857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339a968-2903-49f6-9fd6-f94caae42f15 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:35.015868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc346ce-5c83-49e2-8821-26d6052d43cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:35.016515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc346ce-5c83-49e2-8821-26d6052d43cf None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:35.016794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc346ce-5c83-49e2-8821-26d6052d43cf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:35.017065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc346ce-5c83-49e2-8821-26d6052d43cf None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:35.017752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc346ce-5c83-49e2-8821-26d6052d43cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:35.019189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc346ce-5c83-49e2-8821-26d6052d43cf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:35.038511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 561/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 20:00:34 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:37.253737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62e410-3a9d-4083-9c35-1697b0f9c85d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:37.254273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62e410-3a9d-4083-9c35-1697b0f9c85d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:37.254600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62e410-3a9d-4083-9c35-1697b0f9c85d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:37.256058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 550/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:37.261196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07e97-400f-4377-9b2c-7bda08877565 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:37.261587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07e97-400f-4377-9b2c-7bda08877565 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:37.261759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce07e97-400f-4377-9b2c-7bda08877565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:37.278594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8ce07e97-400f-4377-9b2c-7bda08877565 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:37.279811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8ce07e97-400f-4377-9b2c-7bda08877565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:37.293179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:37.346404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 562/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:37.370401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62e410-3a9d-4083-9c35-1697b0f9c85d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:37.467742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62e410-3a9d-4083-9c35-1697b0f9c85d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:37.505393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:37.506174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:37.506456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:37.506728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] PATH_INFO: `/v3/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:37.508214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] RBAC: Authorizing `identity:get_role(role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:37.509564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:37.510950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 551/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:37 2022] GET /identity/v3/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:37.517089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce07e97-400f-4377-9b2c-7bda08877565 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:37.622213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce07e97-400f-4377-9b2c-7bda08877565 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:37.655347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:37.656207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:37.656491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:37.656767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] PATH_INFO: `/v3/users/c31c584537404858a2361a74bcaef516` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:37.669844 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] RBAC: Authorizing `identity:get_user(user_id=c31c584537404858a2361a74bcaef516)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:37.671320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:37.672934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 563/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:37 2022] GET /identity/v3/users/c31c584537404858a2361a74bcaef516 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:37.679267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:37.691185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:37.775120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415993e7-8de0-42ad-b775-2a93c601b8e3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:37.807952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:37.808583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:37.808865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:37.809138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:37.875762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:37.877215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:37.888158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:37.973766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 552/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:37.979626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:37.988319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:38.078621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ef26c-7389-4c65-a279-af934a923a41 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:38.111851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5dbb4-8668-4d46-b5bf-26d3d913f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:38.112695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5dbb4-8668-4d46-b5bf-26d3d913f476 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:38.112976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5dbb4-8668-4d46-b5bf-26d3d913f476 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:38.113275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5dbb4-8668-4d46-b5bf-26d3d913f476 None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:38.114442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5dbb4-8668-4d46-b5bf-26d3d913f476 None admin] RBAC: Authorizing `identity:get_project(project_id=58738a4b584e408ca8e74fb0406bb2f2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:38.115907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5dbb4-8668-4d46-b5bf-26d3d913f476 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:38.117576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 564/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:37 2022] GET /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:38.123559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:38.242347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d97b9-9ad9-4785-8f93-e53f3ba213f4 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:38.252611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:38.275776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184ef8e-f08f-4d78-a4cd-c424c7797a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:38.276425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ef8e-f08f-4d78-a4cd-c424c7797a2b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:38.276708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ef8e-f08f-4d78-a4cd-c424c7797a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:38.276986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184ef8e-f08f-4d78-a4cd-c424c7797a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:38.277810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184ef8e-f08f-4d78-a4cd-c424c7797a2b None admin] RBAC: Adding query filter params (role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=58738a4b584e408ca8e74fb0406bb2f2, user.id=c31c584537404858a2361a74bcaef516) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:38.278121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184ef8e-f08f-4d78-a4cd-c424c7797a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:38.279564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184ef8e-f08f-4d78-a4cd-c424c7797a2b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:38.284892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 553/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:38 2022] GET /identity/v3/role_assignments?user.id=c31c584537404858a2361a74bcaef516&scope.project.id=58738a4b584e408ca8e74fb0406bb2f2&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:40.436585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8418-9bf2-4e1c-aafc-c3d499a6ac07 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:40.437115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8418-9bf2-4e1c-aafc-c3d499a6ac07 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:40.437115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e8418-9bf2-4e1c-aafc-c3d499a6ac07 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:40.438467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 565/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:40.443934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875383-73a6-4e43-bb29-39432e335c9f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:40.444351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875383-73a6-4e43-bb29-39432e335c9f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:40.444486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875383-73a6-4e43-bb29-39432e335c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:40.461457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b6875383-73a6-4e43-bb29-39432e335c9f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:40.462623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6875383-73a6-4e43-bb29-39432e335c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:40.527329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 554/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:40.549245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8418-9bf2-4e1c-aafc-c3d499a6ac07 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:40.623253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:40.650077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e8418-9bf2-4e1c-aafc-c3d499a6ac07 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:40.682510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:40.683380 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:40.683660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:40.683939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] PATH_INFO: `/v3/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:40.685369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] RBAC: Authorizing `identity:get_role(role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:40.686776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:40.688087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 566/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:40 2022] GET /identity/v3/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:40.694575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875383-73a6-4e43-bb29-39432e335c9f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:40.789150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875383-73a6-4e43-bb29-39432e335c9f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:40.791415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:40.822468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:40.823354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:40.823637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:40.823920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] PATH_INFO: `/v3/users/c31c584537404858a2361a74bcaef516` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:40.825093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=c31c584537404858a2361a74bcaef516)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:40.826503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:40.828123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 555/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:40 2022] GET /identity/v3/users/c31c584537404858a2361a74bcaef516 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:40.834349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:40.929300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3c434-f574-4783-b043-8e331f2745c0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:40.963181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1907c-ae21-444c-b4eb-0af694d0d6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:40.963956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1907c-ae21-444c-b4eb-0af694d0d6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:40.964239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1907c-ae21-444c-b4eb-0af694d0d6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:40.964513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1907c-ae21-444c-b4eb-0af694d0d6d7 None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:40.965672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1907c-ae21-444c-b4eb-0af694d0d6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=58738a4b584e408ca8e74fb0406bb2f2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:40.967116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1907c-ae21-444c-b4eb-0af694d0d6d7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:40.968759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 567/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:40 2022] GET /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:40.974564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:41.072153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f08cd56-e8ce-43a8-b9fb-0d6d84df5ae9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:41.105155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd67a2-4822-45dc-a89a-4864489d7d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:41.106025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd67a2-4822-45dc-a89a-4864489d7d75 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:41.106312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd67a2-4822-45dc-a89a-4864489d7d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:41.106587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd67a2-4822-45dc-a89a-4864489d7d75 None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2/users/c31c584537404858a2361a74bcaef516/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:41.108777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd67a2-4822-45dc-a89a-4864489d7d75 None admin] RBAC: Authorizing `identity:create_grant(project_id=58738a4b584e408ca8e74fb0406bb2f2, user_id=c31c584537404858a2361a74bcaef516, role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:41.110195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd67a2-4822-45dc-a89a-4864489d7d75 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:41.123736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 556/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:00:40 2022] PUT /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2/users/c31c584537404858a2361a74bcaef516/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:00:43.283448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3496-2029-4acf-8d73-90fbe8556b7d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:43.283995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3496-2029-4acf-8d73-90fbe8556b7d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:43.283995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3496-2029-4acf-8d73-90fbe8556b7d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:43.285344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 568/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:43.290674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9829-eca0-4574-a4f6-295e187c24dd None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:43.291119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9829-eca0-4574-a4f6-295e187c24dd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:43.291253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acf9829-eca0-4574-a4f6-295e187c24dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:43.308043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8acf9829-eca0-4574-a4f6-295e187c24dd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:43.309201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8acf9829-eca0-4574-a4f6-295e187c24dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:43.334546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:43.374350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 557/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:43.397303 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d3496-2029-4acf-8d73-90fbe8556b7d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:43.409273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:43.502099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d3496-2029-4acf-8d73-90fbe8556b7d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:43.534889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:43.535669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:43.535946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:43.536218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] PATH_INFO: `/v3/roles/be5e20ee2c644f9a9fe1924d2b81a775` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:43.537658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] RBAC: Authorizing `identity:get_role(role_id=be5e20ee2c644f9a9fe1924d2b81a775)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:43.539080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:43.540430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 569/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:43 2022] GET /identity/v3/roles/be5e20ee2c644f9a9fe1924d2b81a775 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:43.546241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9829-eca0-4574-a4f6-295e187c24dd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:43.643817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acf9829-eca0-4574-a4f6-295e187c24dd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:43.677233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:43.678094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:43.678377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:43.678652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] PATH_INFO: `/v3/users/c31c584537404858a2361a74bcaef516` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:43.679851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] RBAC: Authorizing `identity:get_user(user_id=c31c584537404858a2361a74bcaef516)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:43.681288 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:43.683061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 558/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:43 2022] GET /identity/v3/users/c31c584537404858a2361a74bcaef516 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:43.688642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:43.762631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:43.783467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb8d04-1aa5-4b9a-81f0-1e086876f4f0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:43.817701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:43.818516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:43.818795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:43.819090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:43.883467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:43.884900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:43.956638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:43.978558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 570/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:43.984437 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:44.014688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:44.082266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d77b8-6616-446c-a182-791c1183ce3e None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:44.118653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0a9e7-0407-49d7-b3b6-895cb8f52c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:44.119525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a9e7-0407-49d7-b3b6-895cb8f52c64 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:44.119815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a9e7-0407-49d7-b3b6-895cb8f52c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:44.120092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0a9e7-0407-49d7-b3b6-895cb8f52c64 None admin] PATH_INFO: `/v3/projects/58738a4b584e408ca8e74fb0406bb2f2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:44.121257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0a9e7-0407-49d7-b3b6-895cb8f52c64 None admin] RBAC: Authorizing `identity:get_project(project_id=58738a4b584e408ca8e74fb0406bb2f2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:44.122680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0a9e7-0407-49d7-b3b6-895cb8f52c64 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:44.124392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 559/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:43 2022] GET /identity/v3/projects/58738a4b584e408ca8e74fb0406bb2f2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:44.130984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:44.224060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d6164-e9dd-4bac-8a95-d5edaf987fd1 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:44.257158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7f5a2-eb4e-45f6-8971-d05e0d5df31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:44.257802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f5a2-eb4e-45f6-8971-d05e0d5df31c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:44.258081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f5a2-eb4e-45f6-8971-d05e0d5df31c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:44.258352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7f5a2-eb4e-45f6-8971-d05e0d5df31c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:44.259194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f5a2-eb4e-45f6-8971-d05e0d5df31c None admin] RBAC: Adding query filter params (role.id=be5e20ee2c644f9a9fe1924d2b81a775, scope.project.id=58738a4b584e408ca8e74fb0406bb2f2, user.id=c31c584537404858a2361a74bcaef516) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:44.259502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f5a2-eb4e-45f6-8971-d05e0d5df31c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:44.261016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7f5a2-eb4e-45f6-8971-d05e0d5df31c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:44.266576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 571/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:44 2022] GET /identity/v3/role_assignments?user.id=c31c584537404858a2361a74bcaef516&scope.project.id=58738a4b584e408ca8e74fb0406bb2f2&role.id=be5e20ee2c644f9a9fe1924d2b81a775 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:46.470462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22fb7-042a-448e-b3dc-4659882de4db None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:46.471067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22fb7-042a-448e-b3dc-4659882de4db None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:46.471067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d22fb7-042a-448e-b3dc-4659882de4db None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:46.472470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 560/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:46.477550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc7c2-502a-4c52-9d2e-3dae8dd3e2e3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:46.477943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc7c2-502a-4c52-9d2e-3dae8dd3e2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:46.478105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7dc7c2-502a-4c52-9d2e-3dae8dd3e2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:46.494943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9f7dc7c2-502a-4c52-9d2e-3dae8dd3e2e3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:46.496105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9f7dc7c2-502a-4c52-9d2e-3dae8dd3e2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:46.530219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:46.560990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 572/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:46.585345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22fb7-042a-448e-b3dc-4659882de4db None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:46.680866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:46.685837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d22fb7-042a-448e-b3dc-4659882de4db None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:46.718140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92021dc3-0e45-4a5d-992f-bf6b3579847e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:46.718951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92021dc3-0e45-4a5d-992f-bf6b3579847e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:46.719235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92021dc3-0e45-4a5d-992f-bf6b3579847e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:46.719509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92021dc3-0e45-4a5d-992f-bf6b3579847e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:46.720743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92021dc3-0e45-4a5d-992f-bf6b3579847e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:46.722113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92021dc3-0e45-4a5d-992f-bf6b3579847e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:46.724247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 561/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:46.730138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dc7c2-502a-4c52-9d2e-3dae8dd3e2e3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:46.826234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7dc7c2-502a-4c52-9d2e-3dae8dd3e2e3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:46.858855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2257344-c4c6-4076-81ae-94931cac5144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:46.859566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2257344-c4c6-4076-81ae-94931cac5144 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:46.859854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2257344-c4c6-4076-81ae-94931cac5144 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:46.860131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2257344-c4c6-4076-81ae-94931cac5144 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:46.860840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2257344-c4c6-4076-81ae-94931cac5144 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:46.862257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2257344-c4c6-4076-81ae-94931cac5144 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:46.886933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 573/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 20:00:46 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:00:49.105326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ef27-f8de-4f39-a315-505790e06282 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:49.105829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ef27-f8de-4f39-a315-505790e06282 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:49.105919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348ef27-f8de-4f39-a315-505790e06282 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:49.107286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 562/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:49.112529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9f921-7b31-4b2b-a239-974c8a9998f8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:49.112919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9f921-7b31-4b2b-a239-974c8a9998f8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:49.113129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9f921-7b31-4b2b-a239-974c8a9998f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:49.130110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fbb9f921-7b31-4b2b-a239-974c8a9998f8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:49.131319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fbb9f921-7b31-4b2b-a239-974c8a9998f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:49.150067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:49.198719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 574/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:49.223579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348ef27-f8de-4f39-a315-505790e06282 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:49.322239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348ef27-f8de-4f39-a315-505790e06282 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:49.355427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ccbee-1e2f-459e-bdce-ac642ac0e32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:49.356149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccbee-1e2f-459e-bdce-ac642ac0e32e None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:49.356435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccbee-1e2f-459e-bdce-ac642ac0e32e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:49.356713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ccbee-1e2f-459e-bdce-ac642ac0e32e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:49.357875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ccbee-1e2f-459e-bdce-ac642ac0e32e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:49.359323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407ccbee-1e2f-459e-bdce-ac642ac0e32e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:49.360931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 563/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:00:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:49.367184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9f921-7b31-4b2b-a239-974c8a9998f8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:49.460894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb9f921-7b31-4b2b-a239-974c8a9998f8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:49.492980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974ad42-e106-4c44-89fd-89d51fba7097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:49.493628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ad42-e106-4c44-89fd-89d51fba7097 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:49.493906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ad42-e106-4c44-89fd-89d51fba7097 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:49.494180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974ad42-e106-4c44-89fd-89d51fba7097 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:49.494904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974ad42-e106-4c44-89fd-89d51fba7097 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:49.496317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974ad42-e106-4c44-89fd-89d51fba7097 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:49.515774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 575/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 20:00:49 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:00:51.721910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf9855-2181-4256-81c5-473d368b137f None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:51.723014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf9855-2181-4256-81c5-473d368b137f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:51.723103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf9855-2181-4256-81c5-473d368b137f None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:51.724410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 564/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:51.729657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc33e-6a29-451e-8cdc-065b889d4192 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:51.730088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc33e-6a29-451e-8cdc-065b889d4192 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:51.730216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bc33e-6a29-451e-8cdc-065b889d4192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:51.746541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-667bc33e-6a29-451e-8cdc-065b889d4192 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:51.747750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-667bc33e-6a29-451e-8cdc-065b889d4192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:51.750417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:51.812001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 576/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:00:51.835671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf9855-2181-4256-81c5-473d368b137f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:51.870084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:51.936090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf9855-2181-4256-81c5-473d368b137f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:51.970384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:51.971192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:51.971481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:51.971761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:51.981600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:51.989312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:51.990383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:51.991298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 565/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:51.996276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc33e-6a29-451e-8cdc-065b889d4192 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:52.091332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bc33e-6a29-451e-8cdc-065b889d4192 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:52.123171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:52.123819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:52.124101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:52.124377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:52.125144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:52.125447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:52.126808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:52.135151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 577/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:52.140979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:52.233868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:52.241464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abb40c-d7f9-4b37-9fbf-cceebe0dceaa None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:52.274133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:52.275026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:52.275312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:52.275588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] PATH_INFO: `/v3/users/32e2c6d070f543f4987926279a94a4d0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:52.288463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] RBAC: Authorizing `identity:get_user(user_id=32e2c6d070f543f4987926279a94a4d0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:52.289889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:52.291550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 566/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:52 2022] GET /identity/v3/users/32e2c6d070f543f4987926279a94a4d0 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:52.297369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:52.300723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:52.396873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6df0-97b1-476f-8fc6-1a8a0f387751 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:52.428777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:52.429417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:52.429700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:52.429977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:52.505681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:52.507086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:52.508932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:52.603273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 578/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:52.609142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:52.706201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86d891-de8c-4964-8912-f3386287fe5d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:52.739076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b9501-0fa9-4ff9-8eb8-caa6f6a0788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:52.739923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b9501-0fa9-4ff9-8eb8-caa6f6a0788c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:52.740202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b9501-0fa9-4ff9-8eb8-caa6f6a0788c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:52.740474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b9501-0fa9-4ff9-8eb8-caa6f6a0788c None admin] PATH_INFO: `/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:52.741625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b9501-0fa9-4ff9-8eb8-caa6f6a0788c None admin] RBAC: Authorizing `identity:get_project(project_id=a5ee55dc1ce1484f8db012bb5db90adc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:52.743066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b9501-0fa9-4ff9-8eb8-caa6f6a0788c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:52.744721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 567/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:52 2022] GET /identity/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:00:52.750777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:52.847951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37647e-c2e0-4d63-affb-192451aa330b None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:52.849580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:52.883431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9d8e1-61de-4115-8fba-b94f7b54664f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:52.884093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9d8e1-61de-4115-8fba-b94f7b54664f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:52.884376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9d8e1-61de-4115-8fba-b94f7b54664f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:52.884653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9d8e1-61de-4115-8fba-b94f7b54664f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:52.885477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9d8e1-61de-4115-8fba-b94f7b54664f None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=a5ee55dc1ce1484f8db012bb5db90adc, user.id=32e2c6d070f543f4987926279a94a4d0) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:52.885791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9d8e1-61de-4115-8fba-b94f7b54664f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:52.887252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c9d8e1-61de-4115-8fba-b94f7b54664f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:52.892517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 579/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:52 2022] GET /identity/v3/role_assignments?user.id=32e2c6d070f543f4987926279a94a4d0&scope.project.id=a5ee55dc1ce1484f8db012bb5db90adc&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:55.057817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd24cc5-ef29-4eb0-aca3-5b8ef5224fac None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:55.058339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd24cc5-ef29-4eb0-aca3-5b8ef5224fac None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:55.058339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd24cc5-ef29-4eb0-aca3-5b8ef5224fac None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:55.059712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 568/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:55.064931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c26f0-bb04-4feb-8187-43d51dc787b3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:55.065331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c26f0-bb04-4feb-8187-43d51dc787b3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:55.065494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c26f0-bb04-4feb-8187-43d51dc787b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:55.082187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-872c26f0-bb04-4feb-8187-43d51dc787b3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:55.083408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-872c26f0-bb04-4feb-8187-43d51dc787b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:55.147713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 580/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:55.170091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd24cc5-ef29-4eb0-aca3-5b8ef5224fac None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:55.192105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:55.271362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd24cc5-ef29-4eb0-aca3-5b8ef5224fac None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:55.304656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:55.305446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:55.305734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:55.306013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:55.316053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:55.324019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:55.325085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:00:55.326099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 569/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:55.331140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c26f0-bb04-4feb-8187-43d51dc787b3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:55.422477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:55.429439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c26f0-bb04-4feb-8187-43d51dc787b3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:55.462324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:55.463011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:55.463300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:55.463576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:55.464324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:55.464629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:55.465996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:55.473768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 581/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:55.479758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:55.558249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:55.577548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0b45f-f304-4cf5-986f-0e1e428e27ef None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:55.616285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:55.617143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:55.617424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:55.617697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] PATH_INFO: `/v3/users/32e2c6d070f543f4987926279a94a4d0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:55.618878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] RBAC: Authorizing `identity:get_user(user_id=32e2c6d070f543f4987926279a94a4d0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:55.620301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:55.621922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 570/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:55 2022] GET /identity/v3/users/32e2c6d070f543f4987926279a94a4d0 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:55.627701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:55.725479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a6a1-0b9b-4ca1-94d2-e04ba736dc36 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:55.757522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3376ff-632d-4b59-b7cf-7ce21aad59fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:55.758366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3376ff-632d-4b59-b7cf-7ce21aad59fe None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:55.758647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3376ff-632d-4b59-b7cf-7ce21aad59fe None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:55.758952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3376ff-632d-4b59-b7cf-7ce21aad59fe None admin] PATH_INFO: `/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:55.760116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3376ff-632d-4b59-b7cf-7ce21aad59fe None admin] RBAC: Authorizing `identity:get_project(project_id=a5ee55dc1ce1484f8db012bb5db90adc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:55.761534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3376ff-632d-4b59-b7cf-7ce21aad59fe None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:55.763231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 582/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:55 2022] GET /identity/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:55.769048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:55.865933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac0868-bc0e-48c5-b7f8-1b0bc2467267 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:55.897473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6425609-69ba-4534-b92b-25da1daaa805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:55.898346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425609-69ba-4534-b92b-25da1daaa805 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:55.898625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425609-69ba-4534-b92b-25da1daaa805 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:55.898925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6425609-69ba-4534-b92b-25da1daaa805 None admin] PATH_INFO: `/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc/users/32e2c6d070f543f4987926279a94a4d0/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:55.900843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6425609-69ba-4534-b92b-25da1daaa805 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ee55dc1ce1484f8db012bb5db90adc, user_id=32e2c6d070f543f4987926279a94a4d0, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:55.902252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6425609-69ba-4534-b92b-25da1daaa805 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:55.915633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 571/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:00:55 2022] PUT /identity/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc/users/32e2c6d070f543f4987926279a94a4d0/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:00:58.087372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d999d16-69d6-4e8a-9b80-ab46a7b239ce None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:58.087920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d999d16-69d6-4e8a-9b80-ab46a7b239ce None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:58.087920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d999d16-69d6-4e8a-9b80-ab46a7b239ce None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:58.089228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 583/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:00:58.094561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe2e1-c501-4a5a-ad62-91cd2a45fd45 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:58.095036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe2e1-c501-4a5a-ad62-91cd2a45fd45 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:58.095160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe2e1-c501-4a5a-ad62-91cd2a45fd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:58.113345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a7abe2e1-c501-4a5a-ad62-91cd2a45fd45 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:00:58.114523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a7abe2e1-c501-4a5a-ad62-91cd2a45fd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:58.116479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:58.182020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 572/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:00:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:00:58.205256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d999d16-69d6-4e8a-9b80-ab46a7b239ce None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:58.232491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:58.305729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d999d16-69d6-4e8a-9b80-ab46a7b239ce None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:58.339866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:58.340848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:58.341170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:58.341493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:58.352551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:00:58.360270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:00:58.361439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:00:58.362655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 584/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:00:58.367324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abe2e1-c501-4a5a-ad62-91cd2a45fd45 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:58.468944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abe2e1-c501-4a5a-ad62-91cd2a45fd45 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:58.502420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:58.503161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:58.503956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:58.504236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:58.504982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:58.505290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:58.506646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:58.511570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:58.516182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 573/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:58.521239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:58.602982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:58.618444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251a19c-11c4-4e14-bed0-ac6c9a42892c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:58.651999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:58.652869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:58.653154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:58.653428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] PATH_INFO: `/v3/users/32e2c6d070f543f4987926279a94a4d0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:58.654606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] RBAC: Authorizing `identity:get_user(user_id=32e2c6d070f543f4987926279a94a4d0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:58.656066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:58.657676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 585/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:00:58 2022] GET /identity/v3/users/32e2c6d070f543f4987926279a94a4d0 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:58.663968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:58.785159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ef446-ec4f-4f6e-b02b-199378c23d13 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:58.817965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:58.818609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:58.818922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:58.819206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:58.881855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:58.883999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:58.885902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:58.980340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 574/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:00:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:00:58.986237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:59.084019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ff924-7e1e-4573-b43b-077d63dde1e7 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:59.118683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237463d-8891-456f-ad60-4d279baa4a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:59.119569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237463d-8891-456f-ad60-4d279baa4a80 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:59.119852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237463d-8891-456f-ad60-4d279baa4a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:59.120125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237463d-8891-456f-ad60-4d279baa4a80 None admin] PATH_INFO: `/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:59.121297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237463d-8891-456f-ad60-4d279baa4a80 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ee55dc1ce1484f8db012bb5db90adc)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:59.122738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237463d-8891-456f-ad60-4d279baa4a80 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:59.124459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 586/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:00:58 2022] GET /identity/v3/projects/a5ee55dc1ce1484f8db012bb5db90adc => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:00:59.130526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:59.225220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:59.227942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d7a6e-ec6f-4a80-8458-ee306e3658c9 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:59.261090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7164fe-c7da-4f63-b2ea-86bbd76d2286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:59.261733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7164fe-c7da-4f63-b2ea-86bbd76d2286 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:59.262020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7164fe-c7da-4f63-b2ea-86bbd76d2286 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:59.262300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7164fe-c7da-4f63-b2ea-86bbd76d2286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:59.263157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7164fe-c7da-4f63-b2ea-86bbd76d2286 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=a5ee55dc1ce1484f8db012bb5db90adc, user.id=32e2c6d070f543f4987926279a94a4d0) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:00:59.263474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7164fe-c7da-4f63-b2ea-86bbd76d2286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:59.264901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7164fe-c7da-4f63-b2ea-86bbd76d2286 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:59.271111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 575/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:00:59 2022] GET /identity/v3/role_assignments?user.id=32e2c6d070f543f4987926279a94a4d0&scope.project.id=a5ee55dc1ce1484f8db012bb5db90adc&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:01.457515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80f52-6528-4d05-88ac-01b9975db66a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:01.458049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80f52-6528-4d05-88ac-01b9975db66a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:01.458049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee80f52-6528-4d05-88ac-01b9975db66a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:01.459424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 587/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:01:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:01:01.464711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326cf7-e673-493f-bd38-e8aa941e02c0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:01.465120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326cf7-e673-493f-bd38-e8aa941e02c0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:01.465266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d326cf7-e673-493f-bd38-e8aa941e02c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:01.482292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3d326cf7-e673-493f-bd38-e8aa941e02c0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:01:01.483492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3d326cf7-e673-493f-bd38-e8aa941e02c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:01:01.548974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 576/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:01:01.572123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee80f52-6528-4d05-88ac-01b9975db66a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:01.595383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:01.674097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee80f52-6528-4d05-88ac-01b9975db66a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:01.708174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:01.708746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:01.709028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:01.709304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:01.773634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:01.775093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:01.797096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:01.870438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 588/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:01:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:01:01.876547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d326cf7-e673-493f-bd38-e8aa941e02c0 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:01.965040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:01.972355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d326cf7-e673-493f-bd38-e8aa941e02c0 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:02.005362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6fb25-0de1-4fe2-b0e0-afff8da8222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:02.006162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fb25-0de1-4fe2-b0e0-afff8da8222d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:02.006448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fb25-0de1-4fe2-b0e0-afff8da8222d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:02.006726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fb25-0de1-4fe2-b0e0-afff8da8222d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:02.013309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6fb25-0de1-4fe2-b0e0-afff8da8222d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:02.014737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6fb25-0de1-4fe2-b0e0-afff8da8222d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-6df6fb25-0de1-4fe2-b0e0-afff8da8222d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:01:02.029223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:01:02.030422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:01:02.031339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 577/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 20:01:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:01:02.036864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:02.132100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6912abe-bdd2-40c7-aa3c-1e44cc7f8604 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:02.155070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:02.167076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82aaa9d-0b8c-4e59-91c6-dd0d329cd490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:02.167720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82aaa9d-0b8c-4e59-91c6-dd0d329cd490 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:02.167999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82aaa9d-0b8c-4e59-91c6-dd0d329cd490 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:02.168270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82aaa9d-0b8c-4e59-91c6-dd0d329cd490 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:02.168976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82aaa9d-0b8c-4e59-91c6-dd0d329cd490 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:01:02.169273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82aaa9d-0b8c-4e59-91c6-dd0d329cd490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:02.170616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82aaa9d-0b8c-4e59-91c6-dd0d329cd490 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:02.180056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 589/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu May 26 20:01:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:04.436206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07dc1-4846-4c48-bcd8-eea35e375a29 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:04.436754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07dc1-4846-4c48-bcd8-eea35e375a29 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:04.436754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a07dc1-4846-4c48-bcd8-eea35e375a29 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:04.438134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 578/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:01:04.444399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71021-9f41-4c37-a4ec-3a37d8767895 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:04.444818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71021-9f41-4c37-a4ec-3a37d8767895 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:04.444963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc71021-9f41-4c37-a4ec-3a37d8767895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:04.461260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fbc71021-9f41-4c37-a4ec-3a37d8767895 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:01:04.462442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fbc71021-9f41-4c37-a4ec-3a37d8767895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:01:04.528137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 590/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:01:04.551205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07dc1-4846-4c48-bcd8-eea35e375a29 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:04.650520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a07dc1-4846-4c48-bcd8-eea35e375a29 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:04.683877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2357f-36fc-4591-a899-3ec418d22e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:04.684533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2357f-36fc-4591-a899-3ec418d22e8c None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:04.684821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2357f-36fc-4591-a899-3ec418d22e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:04.685100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2357f-36fc-4591-a899-3ec418d22e8c None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:04.685840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2357f-36fc-4591-a899-3ec418d22e8c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:04.687339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2357f-36fc-4591-a899-3ec418d22e8c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:04.702422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 579/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu May 26 20:01:04 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:01:06.895165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965bfc-5218-42fd-851c-25ec4ca06a96 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:06.895667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965bfc-5218-42fd-851c-25ec4ca06a96 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:06.895667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a965bfc-5218-42fd-851c-25ec4ca06a96 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:06.896982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 591/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:01:06.902259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2cecf-c9fd-42b7-a18e-d66beb7a334a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:06.902681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2cecf-c9fd-42b7-a18e-d66beb7a334a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:06.902825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2cecf-c9fd-42b7-a18e-d66beb7a334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:06.919323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-80b2cecf-c9fd-42b7-a18e-d66beb7a334a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:01:06.920478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-80b2cecf-c9fd-42b7-a18e-d66beb7a334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:01:06.929434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:06.986249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 580/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:01:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:01:07.009423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a965bfc-5218-42fd-851c-25ec4ca06a96 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:07.106937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a965bfc-5218-42fd-851c-25ec4ca06a96 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:07.123254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:07.140996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa456c8-1bb9-4a5f-9710-e4185ac5faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:07.141845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa456c8-1bb9-4a5f-9710-e4185ac5faa0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:07.142126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa456c8-1bb9-4a5f-9710-e4185ac5faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:07.142399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa456c8-1bb9-4a5f-9710-e4185ac5faa0 None admin] PATH_INFO: `/v3/domains/6e606d09ef2647fa82636807f1f6131d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:07.153100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa456c8-1bb9-4a5f-9710-e4185ac5faa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e606d09ef2647fa82636807f1f6131d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:07.154473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa456c8-1bb9-4a5f-9710-e4185ac5faa0 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:07.156107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 592/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 26 20:01:07 2022] GET /identity/v3/domains/6e606d09ef2647fa82636807f1f6131d => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:07.161882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2cecf-c9fd-42b7-a18e-d66beb7a334a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:07.258811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2cecf-c9fd-42b7-a18e-d66beb7a334a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:07.291323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd1681-5840-45e9-b81a-3330784d36fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:07.291973 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd1681-5840-45e9-b81a-3330784d36fc None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:07.292257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd1681-5840-45e9-b81a-3330784d36fc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:07.292534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd1681-5840-45e9-b81a-3330784d36fc None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:07.293236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd1681-5840-45e9-b81a-3330784d36fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:07.294650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd1681-5840-45e9-b81a-3330784d36fc None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:07.308539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:07.321136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 581/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 20:01:07 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:01:09.625975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd377a-aaf0-42d0-9e63-4d380eee6f24 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:09.626518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd377a-aaf0-42d0-9e63-4d380eee6f24 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:09.626518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd377a-aaf0-42d0-9e63-4d380eee6f24 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:09.627899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 593/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:01:09.633699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51ddf-6592-4f05-be28-0605eb376609 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:09.633699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51ddf-6592-4f05-be28-0605eb376609 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:09.634136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51ddf-6592-4f05-be28-0605eb376609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:09.650941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-60b51ddf-6592-4f05-be28-0605eb376609 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:01:09.652100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-60b51ddf-6592-4f05-be28-0605eb376609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:01:09.718185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 582/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:01:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:01:09.743715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd377a-aaf0-42d0-9e63-4d380eee6f24 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:09.840726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd377a-aaf0-42d0-9e63-4d380eee6f24 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:09.872892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422c7642-e990-42bc-b35f-91fe001f73c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:09.873730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7642-e990-42bc-b35f-91fe001f73c8 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:09.874013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7642-e990-42bc-b35f-91fe001f73c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:09.874285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422c7642-e990-42bc-b35f-91fe001f73c8 None admin] PATH_INFO: `/v3/domains/6e606d09ef2647fa82636807f1f6131d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:09.875459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7642-e990-42bc-b35f-91fe001f73c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6e606d09ef2647fa82636807f1f6131d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:09.876928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422c7642-e990-42bc-b35f-91fe001f73c8 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:09.879064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 594/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu May 26 20:01:09 2022] GET /identity/v3/domains/6e606d09ef2647fa82636807f1f6131d => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:09.884592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51ddf-6592-4f05-be28-0605eb376609 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:09.979658 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51ddf-6592-4f05-be28-0605eb376609 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:10.004616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:10.013493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd628f-cdd9-4076-987c-e61cf80e247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:10.014146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd628f-cdd9-4076-987c-e61cf80e247e None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:10.014427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd628f-cdd9-4076-987c-e61cf80e247e None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:10.014700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd628f-cdd9-4076-987c-e61cf80e247e None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:10.015425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd628f-cdd9-4076-987c-e61cf80e247e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:10.016822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd628f-cdd9-4076-987c-e61cf80e247e None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:10.037084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 583/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 20:01:09 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:01:12.227946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3cf6f-7f47-4d9a-b47b-f8c2854f0810 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:12.228478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3cf6f-7f47-4d9a-b47b-f8c2854f0810 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:12.228478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3cf6f-7f47-4d9a-b47b-f8c2854f0810 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:12.229847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 595/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:01:12.235067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b338f-4044-42e3-810b-63e1e037b8fb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:12.235436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b338f-4044-42e3-810b-63e1e037b8fb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:12.235627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b338f-4044-42e3-810b-63e1e037b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:12.254571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e18b338f-4044-42e3-810b-63e1e037b8fb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:01:12.255774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e18b338f-4044-42e3-810b-63e1e037b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:01:12.321024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 584/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:01:12.344521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3cf6f-7f47-4d9a-b47b-f8c2854f0810 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:12.389635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:12.442591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3cf6f-7f47-4d9a-b47b-f8c2854f0810 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:12.474728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:12.475524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:12.475808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:12.476081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:12.485769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:01:12.493990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:01:12.495098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:01:12.496159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 596/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:01:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:01:12.501075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b338f-4044-42e3-810b-63e1e037b8fb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:12.600301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b338f-4044-42e3-810b-63e1e037b8fb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:12.613435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:12.637290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:12.637969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:12.638258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:12.638539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:12.639331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:01:12.639640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:12.640993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:12.649157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 585/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:01:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:12.655035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:12.751176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7013b-2c2a-4428-b924-6e3ea6009ddf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:12.753892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:12.783434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:12.784425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:12.784705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:12.784997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] PATH_INFO: `/v3/users/c646555bc9e34e96b5b0c7ef576c1156` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:12.798268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] RBAC: Authorizing `identity:get_user(user_id=c646555bc9e34e96b5b0c7ef576c1156)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:12.800216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:12.801816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 597/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:01:12 2022] GET /identity/v3/users/c646555bc9e34e96b5b0c7ef576c1156 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:12.807655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:12.906914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335c8d2-28ae-4204-9064-0b43da55f241 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:12.939390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:12.940063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:12.940349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:12.940624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:12.980875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:13.005918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:13.007304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:13.100727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 586/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:01:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:01:13.106586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:13.204534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43aa715-3ecb-43df-a341-b95516930370 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:13.237872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b38ab2-94b5-484b-9174-e93fa8111247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:13.238711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38ab2-94b5-484b-9174-e93fa8111247 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:13.239025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38ab2-94b5-484b-9174-e93fa8111247 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:13.239302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b38ab2-94b5-484b-9174-e93fa8111247 None admin] PATH_INFO: `/v3/projects/5401024e040f4b20be28c8cf817c1626` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:13.240474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38ab2-94b5-484b-9174-e93fa8111247 None admin] RBAC: Authorizing `identity:get_project(project_id=5401024e040f4b20be28c8cf817c1626)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:13.241903 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b38ab2-94b5-484b-9174-e93fa8111247 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:13.243594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 598/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:01:13 2022] GET /identity/v3/projects/5401024e040f4b20be28c8cf817c1626 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:13.249430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:13.322610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:13.350703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239ec57-9bee-48d4-8afc-c46b45039204 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:13.384874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e58a7fa-11ab-44fd-95c7-41a30db4cd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:13.385517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a7fa-11ab-44fd-95c7-41a30db4cd61 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:13.385802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a7fa-11ab-44fd-95c7-41a30db4cd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:13.386081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e58a7fa-11ab-44fd-95c7-41a30db4cd61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:13.386931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a7fa-11ab-44fd-95c7-41a30db4cd61 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=5401024e040f4b20be28c8cf817c1626, user.id=c646555bc9e34e96b5b0c7ef576c1156) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:01:13.387245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a7fa-11ab-44fd-95c7-41a30db4cd61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:13.388659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e58a7fa-11ab-44fd-95c7-41a30db4cd61 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:13.394519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 587/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:01:13 2022] GET /identity/v3/role_assignments?user.id=c646555bc9e34e96b5b0c7ef576c1156&scope.project.id=5401024e040f4b20be28c8cf817c1626&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:01:15.577803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23137-22a6-4413-9e3d-88fe8c9fc90a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:15.578331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23137-22a6-4413-9e3d-88fe8c9fc90a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:15.578331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae23137-22a6-4413-9e3d-88fe8c9fc90a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:15.579717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 599/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:01:15.584990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8779645-b88e-41b3-a734-ae7e5f95321e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:15.585424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8779645-b88e-41b3-a734-ae7e5f95321e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:15.585537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8779645-b88e-41b3-a734-ae7e5f95321e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:15.607185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f8779645-b88e-41b3-a734-ae7e5f95321e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:01:15.608349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f8779645-b88e-41b3-a734-ae7e5f95321e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:01:15.676304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 588/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:01:15.699386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23137-22a6-4413-9e3d-88fe8c9fc90a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:15.729007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:15.797974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae23137-22a6-4413-9e3d-88fe8c9fc90a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:15.831267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:15.831994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:15.832284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:15.832560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:15.842437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:01:15.850190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:01:15.851154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:01:15.852022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 600/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:01:15.857379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8779645-b88e-41b3-a734-ae7e5f95321e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:15.923258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:15.956216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8779645-b88e-41b3-a734-ae7e5f95321e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:15.989607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:15.990266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:15.990551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:15.990830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:15.991597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:01:15.991903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:15.993273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:16.001188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 589/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:16.007067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:16.094047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:16.104192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264b40f0-a411-4bac-aaf3-6068ddd42b58 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:16.136488 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:16.137347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:16.137630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:16.137905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] PATH_INFO: `/v3/users/c646555bc9e34e96b5b0c7ef576c1156` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:16.139099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] RBAC: Authorizing `identity:get_user(user_id=c646555bc9e34e96b5b0c7ef576c1156)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:16.140512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:16.142103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 601/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:01:16 2022] GET /identity/v3/users/c646555bc9e34e96b5b0c7ef576c1156 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:16.147823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:16.244227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38007619-5634-4d5f-afd1-e51ddd050605 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:16.274753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:16.280720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ccffb8-bfb5-46fa-91e8-4bcdef752dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:16.281567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccffb8-bfb5-46fa-91e8-4bcdef752dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:16.281850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccffb8-bfb5-46fa-91e8-4bcdef752dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:16.282123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ccffb8-bfb5-46fa-91e8-4bcdef752dd8 None admin] PATH_INFO: `/v3/projects/5401024e040f4b20be28c8cf817c1626` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:16.283310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccffb8-bfb5-46fa-91e8-4bcdef752dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=5401024e040f4b20be28c8cf817c1626)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:16.285312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ccffb8-bfb5-46fa-91e8-4bcdef752dd8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:16.287065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 590/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:01:16 2022] GET /identity/v3/projects/5401024e040f4b20be28c8cf817c1626 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:16.292899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:16.389727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6475f67-476c-4426-b83f-10b1c21818fa None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:16.421523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e100d030-fcf8-4d8e-ae82-37f391674871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:16.422391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d030-fcf8-4d8e-ae82-37f391674871 None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:16.422678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d030-fcf8-4d8e-ae82-37f391674871 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:16.422987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e100d030-fcf8-4d8e-ae82-37f391674871 None admin] PATH_INFO: `/v3/projects/5401024e040f4b20be28c8cf817c1626/users/c646555bc9e34e96b5b0c7ef576c1156/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:16.425403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100d030-fcf8-4d8e-ae82-37f391674871 None admin] RBAC: Authorizing `identity:create_grant(project_id=5401024e040f4b20be28c8cf817c1626, user_id=c646555bc9e34e96b5b0c7ef576c1156, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:16.426818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e100d030-fcf8-4d8e-ae82-37f391674871 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:16.438874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 602/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:01:16 2022] PUT /identity/v3/projects/5401024e040f4b20be28c8cf817c1626/users/c646555bc9e34e96b5b0c7ef576c1156/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:01:18.598249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917c68f-87cf-42f2-abe3-5e95e67722d6 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:18.598804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917c68f-87cf-42f2-abe3-5e95e67722d6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:18.598804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917c68f-87cf-42f2-abe3-5e95e67722d6 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:18.600211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 591/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:01:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:01:18.605353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48f58-04b3-4602-91e7-8214c499ae0a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:18.605721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48f58-04b3-4602-91e7-8214c499ae0a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:18.605913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48f58-04b3-4602-91e7-8214c499ae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:18.622191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-24d48f58-04b3-4602-91e7-8214c499ae0a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:01:18.623403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-24d48f58-04b3-4602-91e7-8214c499ae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:01:18.636475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:18.689614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 603/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:01:18.713348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917c68f-87cf-42f2-abe3-5e95e67722d6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:18.811700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917c68f-87cf-42f2-abe3-5e95e67722d6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:18.844618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:18.845403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:18.845686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:18.845961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:18.856353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:01:18.864211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:01:18.865298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:01:18.866501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 592/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:01:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:01:18.871375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48f58-04b3-4602-91e7-8214c499ae0a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:18.966904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48f58-04b3-4602-91e7-8214c499ae0a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:18.999349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:19.000002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:19.000283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:19.000558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:19.001292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:01:19.001596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:19.003500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:19.011183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 604/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:01:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:19.016732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:19.073574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:19.114019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24d90d-3765-43e7-b04f-6bd736450edb None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:19.146707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:19.147588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:19.147874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:19.148151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] PATH_INFO: `/v3/users/c646555bc9e34e96b5b0c7ef576c1156` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:19.149319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] RBAC: Authorizing `identity:get_user(user_id=c646555bc9e34e96b5b0c7ef576c1156)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:19.150736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:19.152370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 593/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu May 26 20:01:19 2022] GET /identity/v3/users/c646555bc9e34e96b5b0c7ef576c1156 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:01:19.157905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:19.170173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:19.255863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26e21f-ca16-4158-94ef-673eefa9c021 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:19.287203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:19.287831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:19.288113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:19.288388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:19.352684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:19.354107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:19.365131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:19.448748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 605/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:01:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:01:19.454509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:19.551576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b1f049-5432-482d-9c75-4c0648f1158d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:19.583361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:19.592423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd254c-6da3-4d6e-b89d-e8bdc1a901f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:19.593304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd254c-6da3-4d6e-b89d-e8bdc1a901f4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:19.593591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd254c-6da3-4d6e-b89d-e8bdc1a901f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:19.593870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd254c-6da3-4d6e-b89d-e8bdc1a901f4 None admin] PATH_INFO: `/v3/projects/5401024e040f4b20be28c8cf817c1626` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:19.595099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd254c-6da3-4d6e-b89d-e8bdc1a901f4 None admin] RBAC: Authorizing `identity:get_project(project_id=5401024e040f4b20be28c8cf817c1626)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:19.596578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd254c-6da3-4d6e-b89d-e8bdc1a901f4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:19.598302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 594/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu May 26 20:01:19 2022] GET /identity/v3/projects/5401024e040f4b20be28c8cf817c1626 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:19.604715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:01:19.699910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc298b-bfc4-4572-b9df-2bdcf1a5d9b5 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:01:19.710058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:19.733014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16540019-9d91-4faf-b2e7-c4ad7d856826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:01:19.733654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16540019-9d91-4faf-b2e7-c4ad7d856826 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:01:19.733933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16540019-9d91-4faf-b2e7-c4ad7d856826 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:01:19.734205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16540019-9d91-4faf-b2e7-c4ad7d856826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:01:19.735038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16540019-9d91-4faf-b2e7-c4ad7d856826 None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=5401024e040f4b20be28c8cf817c1626, user.id=c646555bc9e34e96b5b0c7ef576c1156) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:01:19.735345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16540019-9d91-4faf-b2e7-c4ad7d856826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:01:19.737341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16540019-9d91-4faf-b2e7-c4ad7d856826 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:01:19.742884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 606/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:01:19 2022] GET /identity/v3/role_assignments?user.id=c646555bc9e34e96b5b0c7ef576c1156&scope.project.id=5401024e040f4b20be28c8cf817c1626&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:01:29.588219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:01:29.740342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=13 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:19.998283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d747-4b80-45c0-8215-4441a1eaa1f2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:19.998960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d747-4b80-45c0-8215-4441a1eaa1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:19.998960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d747-4b80-45c0-8215-4441a1eaa1f2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:20.000165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 595/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:20.010107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43e6e-d5a3-40d0-bb37-f955066ae965 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:20.011004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43e6e-d5a3-40d0-bb37-f955066ae965 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:20.011004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43e6e-d5a3-40d0-bb37-f955066ae965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:20.030927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a0a43e6e-d5a3-40d0-bb37-f955066ae965 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:20.032232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a0a43e6e-d5a3-40d0-bb37-f955066ae965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:20.125734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 607/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:20.152264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9d747-4b80-45c0-8215-4441a1eaa1f2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:20.271506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9d747-4b80-45c0-8215-4441a1eaa1f2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:20.318868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:20.319688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:20.320092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:20.320308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:20.334446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:20.336558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:20.359531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:20.360635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:20.361666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:20.361666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:20.361666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:20.361666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:20.361666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 596/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:20.368594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a43e6e-d5a3-40d0-bb37-f955066ae965 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:20.503334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a43e6e-d5a3-40d0-bb37-f955066ae965 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:20.544460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:20.551860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b62b7-7446-488f-8414-0c658bedb76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:20.552495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b62b7-7446-488f-8414-0c658bedb76f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:20.552821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b62b7-7446-488f-8414-0c658bedb76f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:20.553145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b62b7-7446-488f-8414-0c658bedb76f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:20.553873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b62b7-7446-488f-8414-0c658bedb76f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:20.554183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b62b7-7446-488f-8414-0c658bedb76f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:20.555587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b62b7-7446-488f-8414-0c658bedb76f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:20.569396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 608/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:20.576366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:20.647763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:20.715578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8777a5c-f8db-4821-85a1-984ad2a9ebdd None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:20.754695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb201268-b757-40a0-bacf-630340f7ba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:20.755776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb201268-b757-40a0-bacf-630340f7ba3d None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:20.756302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb201268-b757-40a0-bacf-630340f7ba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:20.756794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb201268-b757-40a0-bacf-630340f7ba3d None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:20.757693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb201268-b757-40a0-bacf-630340f7ba3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:20.759340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb201268-b757-40a0-bacf-630340f7ba3d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:20.785941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 597/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu May 26 20:02:20 2022] POST /identity/v3/users => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:02:23.192286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630672e7-0687-48da-a5c9-b9ff093f92c2 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:23.192948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630672e7-0687-48da-a5c9-b9ff093f92c2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:23.192948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630672e7-0687-48da-a5c9-b9ff093f92c2 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:23.194819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 609/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:23.199885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935419e-24ba-4ee1-83c4-d052468a7c81 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:23.200378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935419e-24ba-4ee1-83c4-d052468a7c81 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:23.200475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935419e-24ba-4ee1-83c4-d052468a7c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:23.220046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f935419e-24ba-4ee1-83c4-d052468a7c81 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:23.221238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f935419e-24ba-4ee1-83c4-d052468a7c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:23.296363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 598/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:23.321825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630672e7-0687-48da-a5c9-b9ff093f92c2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:23.451708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630672e7-0687-48da-a5c9-b9ff093f92c2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:23.495576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:23.496399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:23.496681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:23.497084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:23.508353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:02:23.516274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:23.522217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:23.523388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 610/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 20:02:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:23.525377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935419e-24ba-4ee1-83c4-d052468a7c81 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:23.571868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:23.641833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935419e-24ba-4ee1-83c4-d052468a7c81 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:23.680421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:23.681111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:23.681405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:23.681683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:23.682447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:23.682762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:23.684267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:23.698153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 599/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 20:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:23.699876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:23.768243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:23.824365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3bcc3-f627-4c97-bbd2-449424cc41d0 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:23.862024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:23.862819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:23.863128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:23.863400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:23.874522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:23.876015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:23.894322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:23.895558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:23.896680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:23.896680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:23.896680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:23.896680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:23.896680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 611/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:23.901350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:24.021140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:24.025226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00e87e-2e3a-4f47-9141-65241c4d04ae None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:24.068803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:24.069859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:24.070350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:24.070833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:24.071691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:24.072096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:24.073563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:24.090719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 600/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:24.091938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:24.219399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f45681-e941-4ab1-b7be-ac33865b864e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:24.221807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:24.259543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:24.260367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:24.260684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:24.260933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:24.269200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:24.270648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:02:24.286673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:24.287769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:24.288712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:24.292773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 612/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:02:24.293724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:24.415888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3463cb-8e4a-4049-8c26-003837c94d73 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:24.461422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:24.462096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:24.462389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:24.462700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:24.463587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:24.463886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:24.465311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:24.486135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 601/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 20:02:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:24.491939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:24.608559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbc850-8d91-496b-b0e9-3a5a07ad916f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:24.655184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:24.655840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:24.656159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:24.656506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:24.693210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:24.749623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:24.752050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:24.876136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 613/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:02:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 20:02:24.881857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:24.902616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:24.990688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f528ef-5864-4493-9a58-308932e13a7f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:25.031956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:25.033407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:25.034440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:25.034440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:25.048826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:25.050460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:25.089469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:25.090669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:25.091871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:25.091871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:25.091871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:25.091871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:25.092585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 602/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:25.101063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:25.174880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:25.217672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e97ab4-baea-41c0-8256-51d2e8946c64 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:25.252246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:25.252895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:25.253168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:25.253439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:25.255414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:25.255827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:25.257437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:25.270700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 614/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:02:25.276120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:25.363516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:25.403686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b726f5-43af-44b9-b80a-737038f94907 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:25.453736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:25.455048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:25.455332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:25.455608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:25.466116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:25.467613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:02:25.483489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:25.484473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:25.485407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 603/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:02:25.492602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:25.607147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59466e22-5c50-4290-b772-7ec229760f8f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:25.640118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:25.654295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163c39a-f92d-48f1-aa7e-b99001f34b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:25.655118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163c39a-f92d-48f1-aa7e-b99001f34b82 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:25.655499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163c39a-f92d-48f1-aa7e-b99001f34b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:25.655870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163c39a-f92d-48f1-aa7e-b99001f34b82 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:25.656749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163c39a-f92d-48f1-aa7e-b99001f34b82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:25.657170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163c39a-f92d-48f1-aa7e-b99001f34b82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:25.659425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163c39a-f92d-48f1-aa7e-b99001f34b82 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:25.674465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 615/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:25.681161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:25.825640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78e694-8fb8-40f8-89e4-e56fdb4368a2 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:25.858818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:25.867081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9a5d5-a1e8-4749-aca3-41cbae6a5873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:25.867793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9a5d5-a1e8-4749-aca3-41cbae6a5873 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:25.868111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9a5d5-a1e8-4749-aca3-41cbae6a5873 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:25.868430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9a5d5-a1e8-4749-aca3-41cbae6a5873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:25.869294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9a5d5-a1e8-4749-aca3-41cbae6a5873 None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=1425168ddd274cf3a5c59d0cbedaf0f8) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:25.869638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9a5d5-a1e8-4749-aca3-41cbae6a5873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:25.871117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9a5d5-a1e8-4749-aca3-41cbae6a5873 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:25.877492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 604/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:02:25 2022] GET /identity/v3/role_assignments?user.id=1425168ddd274cf3a5c59d0cbedaf0f8&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:28.106121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e2f8-8d9b-4346-87dd-9a01ec15ad49 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:28.106630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e2f8-8d9b-4346-87dd-9a01ec15ad49 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:28.106748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746e2f8-8d9b-4346-87dd-9a01ec15ad49 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:28.108205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 616/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:28.114087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f176-9f1c-4555-811c-95535833c47a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:28.114597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f176-9f1c-4555-811c-95535833c47a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:28.114701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8f176-9f1c-4555-811c-95535833c47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:28.131681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5ff8f176-9f1c-4555-811c-95535833c47a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:28.132866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5ff8f176-9f1c-4555-811c-95535833c47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:28.217731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 605/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:28.242420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746e2f8-8d9b-4346-87dd-9a01ec15ad49 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:28.362365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746e2f8-8d9b-4346-87dd-9a01ec15ad49 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:28.399247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:28.400127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:28.400455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:28.400700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:28.412526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:02:28.421030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:28.422034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:28.422929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 617/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 20:02:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:28.428567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8f176-9f1c-4555-811c-95535833c47a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:28.541786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8f176-9f1c-4555-811c-95535833c47a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:28.567422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:28.579329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:28.580005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:28.580290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:28.580569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:28.581314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:28.581621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:28.583027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:28.590940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 606/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 20:02:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:28.597391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:28.652056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:28.709998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4db14f-3b0d-4d78-b3de-745c8a77639e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:28.745118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:28.746167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:28.746460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:28.746773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:28.759667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:28.761353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:28.780616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:28.781829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:28.783418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:28.783418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:28.783418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:28.783418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:28.783418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 618/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:28.788280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:28.904710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b1168-8289-40a5-b665-dda4f3fd1a30 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:28.942806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:28.943503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:28.943793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:28.944073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:28.944797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:28.945109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:28.946572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:28.959111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 607/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:28.965100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:29.065288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:29.073761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600be987-72c2-43a5-9a10-5ff1b399be2e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:29.110321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:29.111166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:29.111427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:29.111709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:29.119536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:29.120980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:02:29.138626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:29.139796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:29.141164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:29.144576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 619/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:29.150570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:29.206878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:29.268148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ccf3b-8f9a-480e-82ec-15ed764ee6e8 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:29.305307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:29.305925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:29.306206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:29.306495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:29.307359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:29.307672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:29.309088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:29.326896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 608/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 20:02:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:29.333120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:29.442002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36af85-7f09-4f51-acf2-4b899e039f30 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:29.478335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:29.479081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:29.479367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:29.479646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:29.491974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:29.493434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:29.511531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:29.512713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:29.513695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:29.513695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:29.513695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:29.513695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:29.513695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 620/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:29.519139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:29.621481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493cfa3-bf12-4a85-9ce8-c2559debca5a None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:29.626933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:29.664523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:29.665442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:29.665727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:29.666008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:29.666732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:29.667072 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:29.668496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:29.680533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 609/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:29.686692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:29.696426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:29.792606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5dd75-23c0-4f5c-bb08-00f869f22904 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:29.827827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:29.828657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:29.829484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:29.829783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:29.836968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:29.838556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:02:29.854970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:29.856159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:29.857486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 621/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:02:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:29.863079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:29.967936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913ffd6-7e35-49eb-b88b-a1761e0a3ed0 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:30.006997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe98b0-0314-4c94-938c-02857ebc47e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:30.007806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe98b0-0314-4c94-938c-02857ebc47e5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:30.008147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe98b0-0314-4c94-938c-02857ebc47e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:30.008472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe98b0-0314-4c94-938c-02857ebc47e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:30.009433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe98b0-0314-4c94-938c-02857ebc47e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:30.009770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe98b0-0314-4c94-938c-02857ebc47e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:30.011657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe98b0-0314-4c94-938c-02857ebc47e5 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:30.024939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 610/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:02:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:30.030455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:30.109121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:30.147874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0ad408-8506-4628-9aa1-00b56e17dd2e None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:30.185129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a5dc3-52cc-4afd-b09c-f127ca811d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:30.186015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a5dc3-52cc-4afd-b09c-f127ca811d9f None admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:30.186302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a5dc3-52cc-4afd-b09c-f127ca811d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:30.186570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a5dc3-52cc-4afd-b09c-f127ca811d9f None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/1425168ddd274cf3a5c59d0cbedaf0f8/roles/8c8136abf46a401b83db6fa1665441a3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:30.201849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a5dc3-52cc-4afd-b09c-f127ca811d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=1425168ddd274cf3a5c59d0cbedaf0f8, role_id=8c8136abf46a401b83db6fa1665441a3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:30.203337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68a5dc3-52cc-4afd-b09c-f127ca811d9f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:30.216674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 622/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:02:30 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/1425168ddd274cf3a5c59d0cbedaf0f8/roles/8c8136abf46a401b83db6fa1665441a3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:02:32.467667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37804fd-d425-4b59-b515-779ebecf44ab None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:32.468243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37804fd-d425-4b59-b515-779ebecf44ab None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:32.468243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37804fd-d425-4b59-b515-779ebecf44ab None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:32.470135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 611/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:32.477876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed504427-cce3-44e6-9b32-79b6dd9aa50f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:32.477876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed504427-cce3-44e6-9b32-79b6dd9aa50f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:32.477876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed504427-cce3-44e6-9b32-79b6dd9aa50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:32.495015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ed504427-cce3-44e6-9b32-79b6dd9aa50f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:32.496212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ed504427-cce3-44e6-9b32-79b6dd9aa50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:32.567225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 623/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:32.590594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37804fd-d425-4b59-b515-779ebecf44ab None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:32.615805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:32.702689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37804fd-d425-4b59-b515-779ebecf44ab None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:32.739979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:32.740686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:32.740968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:32.741237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:32.752311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:02:32.760223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:32.761472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:32.762560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 612/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu May 26 20:02:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:02:32.767439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed504427-cce3-44e6-9b32-79b6dd9aa50f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:32.817724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:32.871203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed504427-cce3-44e6-9b32-79b6dd9aa50f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:32.905867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:32.906664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:32.907059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:32.907405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:32.908221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:32.908599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:32.910036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:32.918312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 624/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu May 26 20:02:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:32.924619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:33.015855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:33.034928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a643ea-1ba0-401f-b95f-749d84bfa8dc None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:33.069729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:33.070526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:33.070810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:33.071112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:33.081826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:33.083367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:33.101814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:33.103062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:33.104131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:33.104131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:33.104131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:33.104131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:33.104131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 613/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:33.108963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:33.212692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a24ae7-d7a2-45d2-86a2-7eb7b8c703f3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:33.223126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:33.249474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:33.250219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:33.250581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:33.250972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:33.251690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:33.251998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:33.253390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:33.265575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 625/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:33.271341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:33.385046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a5e26-2a22-433e-bd0d-58c93c64ec4b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:33.423310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:33.424263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:33.424571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:33.424907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:33.427744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:33.433691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:33.435632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:02:33.451215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:33.452398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:33.453362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 614/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:02:33.458780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:33.564517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debb660-458a-4ca2-8875-72c54f88ecb3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:33.604749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:33.605530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:33.605808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:33.606086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:33.607004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:33.607307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:33.608752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:33.628679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 626/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 20:02:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:33.635009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:33.757566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37715a1-8617-4240-b478-e264382dbbd6 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:33.797999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:33.798652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:33.798988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:33.799688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:33.870150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:33.879894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:33.881357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:33.983681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 615/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:02:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:02:33.989570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:34.018564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:34.113886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea3bc2-46a2-4979-b502-bbd8f033d6c4 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:34.151617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:34.152326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:34.153743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:34.153743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:34.162917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:34.164474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:34.184090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:34.185266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:34.186352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:34.186352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:34.186352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:34.186352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:34.186352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 627/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:02:34.191979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:34.289332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:34.295625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068cf9d-bb6b-4468-9f90-6a54f1572563 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:34.331464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:34.332132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:34.332413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:34.332688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:34.333409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:34.333715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:34.335100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:34.347775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 616/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:34.354426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:34.446616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:34.469013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc122f-6d6d-42a3-910f-6b6c2990b16c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:34.504343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:34.505136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:34.505418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:34.505697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:34.512313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:34.513835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:02:34.528098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:34.529359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:34.530640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 628/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:02:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:34.535696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:34.649830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05c56-6bfc-482e-b68e-80b5e5e95c2b None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:34.685355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16207aeb-0434-459e-b11e-235bd1455926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:34.686130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16207aeb-0434-459e-b11e-235bd1455926 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:34.686477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16207aeb-0434-459e-b11e-235bd1455926 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:34.686769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16207aeb-0434-459e-b11e-235bd1455926 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:34.687621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16207aeb-0434-459e-b11e-235bd1455926 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:34.687870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16207aeb-0434-459e-b11e-235bd1455926 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:34.689333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16207aeb-0434-459e-b11e-235bd1455926 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:34.703040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 617/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:02:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:02:34.709280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:34.817737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d65c5f-18b8-432d-a102-bad3869f2582 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:34.851887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91157f0e-9f31-4f31-8af5-5b189fc7ab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:34.852535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91157f0e-9f31-4f31-8af5-5b189fc7ab9a None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:34.852820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91157f0e-9f31-4f31-8af5-5b189fc7ab9a None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:34.853096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91157f0e-9f31-4f31-8af5-5b189fc7ab9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:34.853916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91157f0e-9f31-4f31-8af5-5b189fc7ab9a None admin] RBAC: Adding query filter params (role.id=8c8136abf46a401b83db6fa1665441a3, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=1425168ddd274cf3a5c59d0cbedaf0f8) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:34.854227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91157f0e-9f31-4f31-8af5-5b189fc7ab9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:34.855682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91157f0e-9f31-4f31-8af5-5b189fc7ab9a None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:34.862291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 629/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:02:34 2022] GET /identity/v3/role_assignments?user.id=1425168ddd274cf3a5c59d0cbedaf0f8&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=8c8136abf46a401b83db6fa1665441a3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:37.153295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e74d77-055c-4b8b-9bf1-ca6e3418c786 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:37.153952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e74d77-055c-4b8b-9bf1-ca6e3418c786 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:37.153952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e74d77-055c-4b8b-9bf1-ca6e3418c786 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:37.155250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 618/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:37.160692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8d46-c5f9-46e1-8ded-01c0b11ffcae None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:37.161161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8d46-c5f9-46e1-8ded-01c0b11ffcae None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:37.161291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a8d46-c5f9-46e1-8ded-01c0b11ffcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:37.167384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:37.181836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-503a8d46-c5f9-46e1-8ded-01c0b11ffcae None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:37.183101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-503a8d46-c5f9-46e1-8ded-01c0b11ffcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:37.263486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 630/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:37.290765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e74d77-055c-4b8b-9bf1-ca6e3418c786 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:37.310944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:37.419718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e74d77-055c-4b8b-9bf1-ca6e3418c786 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:37.456648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:37.457466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:37.457749 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:37.458025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:37.469150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:02:37.477420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:37.478515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:37.479497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 619/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:02:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:37.484744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8d46-c5f9-46e1-8ded-01c0b11ffcae None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:37.595124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a8d46-c5f9-46e1-8ded-01c0b11ffcae None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:37.630474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:37.638282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:37.639019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:37.639305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:37.639579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:37.640326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:37.640629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:37.642005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:37.650678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 631/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:02:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:37.657665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:37.745221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:37.767517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf271756-52da-4e11-8d78-045e920d8bd5 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:37.803986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:37.804781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:37.805061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:37.805335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:37.820385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:37.821833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:37.840991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:37.842205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:37.843313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:37.843313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:37.843313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:37.843313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:37.843313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 620/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:37.848827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:37.957744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca1e73-b35a-4244-a79e-d26755b910dc None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:37.992848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:37.993498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:37.993774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:37.994051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:37.994765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:37.995104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:37.996527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:38.015024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 632/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:38.016382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:38.127342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74e00f-a868-44cf-a203-66a7cfab2508 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:38.153627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:38.162044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:38.162880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:38.163171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:38.163453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:38.171125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:38.173117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:02:38.189896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:38.191419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:38.192566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 621/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:38.198017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:38.259047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:38.305071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c62ecda-75ca-4899-9636-caee4b128eb2 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:38.340341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:38.341049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:38.341335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:38.341662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:38.342579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:38.342954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:38.345023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:38.365687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 633/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 20:02:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:02:38.371513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:38.480865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3adf5f-e187-4683-83d6-181c8afa7d1c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:38.518418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:38.519030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:38.519305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:38.519586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:38.579470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:38.592318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:38.593769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:38.703136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 622/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:02:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:02:38.709512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:38.822664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5aedc-0a6e-4aad-ac96-900ec9bde1a3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:38.838009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:38.860554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:38.861375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:38.861667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:38.861928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:38.873138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:38.874631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:38.893924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:38.895096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:38.895998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:38.895998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:38.895998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:38.895998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:38.895998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 634/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:02:38.900926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:38.993967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:39.007215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19583c83-bad9-48dd-9f24-9a461783d6b7 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:39.042706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:39.043395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:39.043680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:39.043959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:39.044689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:39.044995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:39.046377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:39.064558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 623/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:39.066088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:39.170013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70407826-76c8-4278-b8d4-3ded6fbea739 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:39.205617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:39.206426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:39.206710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:39.207015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:39.214318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:39.215842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:02:39.230553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:39.231672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:39.232688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 635/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:39.239419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:39.342659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fea315-fc1e-4efb-9b91-93991e7360a3 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:39.380306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a094a-c731-45ee-8f92-607e20a0a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:39.381065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a094a-c731-45ee-8f92-607e20a0a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:39.381364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a094a-c731-45ee-8f92-607e20a0a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:39.381642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a094a-c731-45ee-8f92-607e20a0a4a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:39.382602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a094a-c731-45ee-8f92-607e20a0a4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:39.382974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a094a-c731-45ee-8f92-607e20a0a4a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:39.384779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a094a-c731-45ee-8f92-607e20a0a4a1 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:39.398215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 624/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:02:39.404731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:39.435189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:39.510545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf016d-59b2-41a7-bec4-d04a8e128a8c None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:39.542240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd3b3d-1418-486a-9dea-dc651ece327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:39.542946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd3b3d-1418-486a-9dea-dc651ece327f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:39.543231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd3b3d-1418-486a-9dea-dc651ece327f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:39.543509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd3b3d-1418-486a-9dea-dc651ece327f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:39.544328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd3b3d-1418-486a-9dea-dc651ece327f None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=1425168ddd274cf3a5c59d0cbedaf0f8) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:39.544639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd3b3d-1418-486a-9dea-dc651ece327f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:39.546058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd3b3d-1418-486a-9dea-dc651ece327f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:39.551849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 636/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:02:39 2022] GET /identity/v3/role_assignments?user.id=1425168ddd274cf3a5c59d0cbedaf0f8&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:41.723115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a82a2-335f-4bb5-a49d-d150a68525f3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:41.723625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a82a2-335f-4bb5-a49d-d150a68525f3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:41.723740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a82a2-335f-4bb5-a49d-d150a68525f3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:41.725032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 625/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:41.730443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d23e-d6f8-4f99-9925-9f2b527b3193 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:41.730932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d23e-d6f8-4f99-9925-9f2b527b3193 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:41.731046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7d23e-d6f8-4f99-9925-9f2b527b3193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:41.748010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c8a7d23e-d6f8-4f99-9925-9f2b527b3193 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:41.749191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c8a7d23e-d6f8-4f99-9925-9f2b527b3193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:41.812542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 637/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:02:41.835381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a82a2-335f-4bb5-a49d-d150a68525f3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:41.846051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:41.934168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a82a2-335f-4bb5-a49d-d150a68525f3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:41.966666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:41.967546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:41.967826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:41.968099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:41.978128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:02:41.986283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:41.987407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:41.988466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 626/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:41.993374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7d23e-d6f8-4f99-9925-9f2b527b3193 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:42.011565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:42.090499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7d23e-d6f8-4f99-9925-9f2b527b3193 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:42.123854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:42.124514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:42.124798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:42.125074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:42.125840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:42.126144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:42.127550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:42.135415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 638/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:42.141168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:42.206759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:42.240318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6d742-cc3a-4fc0-a8d5-510d9d545433 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:42.272212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:42.272996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:42.273285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:42.273562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:42.284471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:42.285904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:42.303256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:42.304271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:42.305227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:42.305227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:42.305227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:42.305227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:42.305227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 627/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:42.309990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:42.393544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:42.414078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4148b76-b291-4387-8fa6-c1a24afc26fe None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:42.447575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:42.448222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:42.448502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:42.448773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:42.449485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:42.449789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:42.451179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:42.463146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 639/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:42.468794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:42.565048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e70a9f-ef3b-4c8a-9f2b-bed8f96d0256 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:42.588607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:42.602242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:42.603058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:42.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:42.603623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:42.611412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:42.612834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:02:42.627304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:42.628379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:42.629531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 628/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:42.634272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:42.729478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3082c5-385c-4c04-8fb2-9cad92418c38 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:42.762580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:42.763268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:42.763547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:42.763818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:42.764630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:42.764932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:42.766372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:42.774670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:42.782918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 640/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 20:02:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:42.788395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:42.884893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3dee1-5eea-4473-b4dc-8329786ec19f None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:42.916711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:42.917479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:42.917761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:42.918035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:42.928800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:42.930218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:42.947060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:42.948085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:42.949011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:42.949011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:42.949011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:42.949011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:42.949011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 629/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:42.953601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:43.049140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60908d77-e161-401d-a44f-8fb20e402468 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:43.081556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:43.082201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:43.082480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:43.082750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:43.083483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:43.083787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:43.085334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:43.096516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 641/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:43.102191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:43.133319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:43.199771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48d5fb-7dd9-4b1e-b768-2b6870ce2888 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:43.232641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:43.233414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:43.233698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:43.233976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:43.240481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:43.241906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:02:43.255987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:43.257014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:43.258127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 630/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:43.262813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:43.320463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:43.362494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649938c-909e-49fc-bf28-e78f1ae78729 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:43.398339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f5d59-5089-4cff-9977-8ef1c35eab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:43.399026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f5d59-5089-4cff-9977-8ef1c35eab3b None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:43.399311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f5d59-5089-4cff-9977-8ef1c35eab3b None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:43.399585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f5d59-5089-4cff-9977-8ef1c35eab3b None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:43.400362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f5d59-5089-4cff-9977-8ef1c35eab3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:43.400669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f5d59-5089-4cff-9977-8ef1c35eab3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:43.402108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f5d59-5089-4cff-9977-8ef1c35eab3b None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:43.414523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 642/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:02:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:43.420428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:43.510099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:43.519337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bacab-f1cd-4de3-b042-72ed861e8188 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:43.552560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99e896-41ed-42e7-828b-5a4d3394f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:43.553442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99e896-41ed-42e7-828b-5a4d3394f988 None admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:43.553728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99e896-41ed-42e7-828b-5a4d3394f988 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:43.554006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99e896-41ed-42e7-828b-5a4d3394f988 None admin] PATH_INFO: `/v3/projects/6201c0c838f44f049269e40cfce28153/users/1425168ddd274cf3a5c59d0cbedaf0f8/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:43.555964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99e896-41ed-42e7-828b-5a4d3394f988 None admin] RBAC: Authorizing `identity:create_grant(project_id=6201c0c838f44f049269e40cfce28153, user_id=1425168ddd274cf3a5c59d0cbedaf0f8, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:43.557384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99e896-41ed-42e7-828b-5a4d3394f988 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:43.570104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 631/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu May 26 20:02:43 2022] PUT /identity/v3/projects/6201c0c838f44f049269e40cfce28153/users/1425168ddd274cf3a5c59d0cbedaf0f8/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:02:45.729910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579565c7-1cbc-4871-8bfc-8dc826e87065 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:45.730434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579565c7-1cbc-4871-8bfc-8dc826e87065 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:45.730434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579565c7-1cbc-4871-8bfc-8dc826e87065 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:45.731839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 643/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:45.737484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9e26-dab3-407a-9bcf-ebed56202ca7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:45.737885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9e26-dab3-407a-9bcf-ebed56202ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:45.738052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9e26-dab3-407a-9bcf-ebed56202ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:45.755140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bf5e9e26-dab3-407a-9bcf-ebed56202ca7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:45.756353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bf5e9e26-dab3-407a-9bcf-ebed56202ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:45.821027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 632/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:02:45.844498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579565c7-1cbc-4871-8bfc-8dc826e87065 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:45.945180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579565c7-1cbc-4871-8bfc-8dc826e87065 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:45.961556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:45.978551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:45.979354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:45.979637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:45.979908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:45.990273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 20:02:45.997909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:45.999014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:46.000058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 644/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu May 26 20:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:46.005001 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9e26-dab3-407a-9bcf-ebed56202ca7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:46.082986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:46.105506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9e26-dab3-407a-9bcf-ebed56202ca7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:46.142374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:46.143070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:46.143355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:46.143629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:46.144373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:46.144678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:46.146033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:46.153928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 633/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu May 26 20:02:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:02:46.160263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:46.257064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f8972-00d5-4a9d-b965-a1b875135d71 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:46.288408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:46.289175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:46.289456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:46.289732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:46.300361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:46.301804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:46.319218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:46.320215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:46.321479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:46.321479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:46.321479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:46.321479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:46.321479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 645/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:46.325878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:46.453032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489211c-aa70-44e4-99bf-8c03779de79c None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:46.492927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:46.493578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:46.493859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:46.494133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:46.494866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:46.495177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:46.496521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:46.508452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 634/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:46.513978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:46.543761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:46.612588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74203ec2-177a-4fed-a7b5-1435f1278aa3 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:46.644871 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:46.645669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:46.645948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:46.646217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] PATH_INFO: `/v3/users/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:46.653421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:46.654877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 20:02:46.669219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:46.670313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:46.671539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 646/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:46.676857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:46.680652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:46.774123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9058a2-169c-4273-bced-1caffdf53358 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:46.807963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:46.808629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:46.808911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:46.809183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:46.810015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:46.810324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:46.811768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:46.828520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 635/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu May 26 20:02:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:46.834256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:46.921198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:46.931033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a743-ad7c-4211-b86e-d20d3634aaee None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:46.963178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:46.963812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:46.964099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:46.964372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:47.027823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:47.029191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:47.115146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:47.124917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 647/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu May 26 20:02:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 20:02:47.130823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:47.190999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:47.229076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd7459-d615-4149-b30e-8f6cbe828436 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:47.261431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:47.262220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:47.262507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:47.262788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:47.273146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:47.274589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 20:02:47.292371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:47.293391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:47.294702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 20:02:47.294702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 20:02:47.294702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 20:02:47.294702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:47.294702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 636/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:47.299084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:47.398975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc330fd-a00f-4fae-9839-c0add6cd29cf None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:47.431230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:47.431885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:47.432166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:47.432439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:47.433149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:47.433451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:47.434816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:47.446425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 648/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu May 26 20:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:47.452019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:47.546763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03a44a-50b8-4b77-aceb-d9476f60e336 None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:47.560056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:47.580763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:47.581534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:47.581814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:47.582090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:47.588539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:47.589954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 20:02:47.603344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application with Lock( May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:47.604364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: ERROR keystone.server.flask.application May 26 20:02:47.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 637/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu May 26 20:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:47.610128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:47.659450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:47.708009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e40be5-68d4-4067-a856-eb64c5d4745f None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:47.739880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ab6d6-eee2-4472-b04d-218c679e8d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:47.740524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ab6d6-eee2-4472-b04d-218c679e8d92 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:47.740803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ab6d6-eee2-4472-b04d-218c679e8d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:47.741075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ab6d6-eee2-4472-b04d-218c679e8d92 None admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:47.741839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ab6d6-eee2-4472-b04d-218c679e8d92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:47.742144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ab6d6-eee2-4472-b04d-218c679e8d92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:47.743585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ab6d6-eee2-4472-b04d-218c679e8d92 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:47.755581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 649/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu May 26 20:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:47.761905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:47.865471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fafbd-050e-4892-8252-c33804a9702d None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:47.897399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3361dbe8-be16-4e21-a08a-dbf5bfa9400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:47.898035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361dbe8-be16-4e21-a08a-dbf5bfa9400b None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:47.898318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361dbe8-be16-4e21-a08a-dbf5bfa9400b None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:47.898647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3361dbe8-be16-4e21-a08a-dbf5bfa9400b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:47.899524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361dbe8-be16-4e21-a08a-dbf5bfa9400b None admin] RBAC: Adding query filter params (role.id=2ea8b640824944d8b1f7628b0fdf4f74, scope.project.id=6201c0c838f44f049269e40cfce28153, user.id=1425168ddd274cf3a5c59d0cbedaf0f8) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:47.899833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361dbe8-be16-4e21-a08a-dbf5bfa9400b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:47.901258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3361dbe8-be16-4e21-a08a-dbf5bfa9400b None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:47.907458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 638/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu May 26 20:02:47 2022] GET /identity/v3/role_assignments?user.id=1425168ddd274cf3a5c59d0cbedaf0f8&scope.project.id=6201c0c838f44f049269e40cfce28153&role.id=2ea8b640824944d8b1f7628b0fdf4f74 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:50.088329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8366fd-539c-4325-a396-c58a6b0c2110 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:50.088836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8366fd-539c-4325-a396-c58a6b0c2110 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:50.088943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8366fd-539c-4325-a396-c58a6b0c2110 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:50.090245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 650/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:50.095861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b579d3-819e-46b1-a8c2-fe9c604eee18 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:50.096258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b579d3-819e-46b1-a8c2-fe9c604eee18 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:50.096409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b579d3-819e-46b1-a8c2-fe9c604eee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:50.112758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c9b579d3-819e-46b1-a8c2-fe9c604eee18 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:50.113918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c9b579d3-819e-46b1-a8c2-fe9c604eee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:50.142476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:50.180237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 639/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 20:02:50.202205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8366fd-539c-4325-a396-c58a6b0c2110 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:50.299137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8366fd-539c-4325-a396-c58a6b0c2110 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:50.309192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:50.332632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:50.333405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:50.333685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:50.333956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:50.334588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:50.335970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:50.348268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:50.349267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:50.350116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 651/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 20:02:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:50.355750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b579d3-819e-46b1-a8c2-fe9c604eee18 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:50.466040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b579d3-819e-46b1-a8c2-fe9c604eee18 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:50.498427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b040657-a1c9-4420-af9c-57064af62c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:50.499115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b040657-a1c9-4420-af9c-57064af62c76 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:50.499401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b040657-a1c9-4420-af9c-57064af62c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:50.499679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b040657-a1c9-4420-af9c-57064af62c76 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:50.500913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b040657-a1c9-4420-af9c-57064af62c76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:50.501217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b040657-a1c9-4420-af9c-57064af62c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:50.502566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b040657-a1c9-4420-af9c-57064af62c76 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:50.507282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 640/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 20:02:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:50.513010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:50.608124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23b34d-78f3-4870-aed2-c6ea5295cf06 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:50.642175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6b52c-cd9b-449a-90bf-55436b005704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:50.642820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6b52c-cd9b-449a-90bf-55436b005704 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:50.643177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6b52c-cd9b-449a-90bf-55436b005704 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:50.643454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6b52c-cd9b-449a-90bf-55436b005704 None admin] PATH_INFO: `/v3/services` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:50.644152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6b52c-cd9b-449a-90bf-55436b005704 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:50.644456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6b52c-cd9b-449a-90bf-55436b005704 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:50.645814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6b52c-cd9b-449a-90bf-55436b005704 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:50.650120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 652/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 20:02:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:02:52.810339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f788f1-69e7-4330-984d-476f2823af49 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:52.810903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f788f1-69e7-4330-984d-476f2823af49 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:52.810903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f788f1-69e7-4330-984d-476f2823af49 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:52.812278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 641/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:52.818182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb94a5-0148-442d-87d1-53ccbb66eb5b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:52.818620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb94a5-0148-442d-87d1-53ccbb66eb5b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:52.818748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb94a5-0148-442d-87d1-53ccbb66eb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:52.835789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-83cb94a5-0148-442d-87d1-53ccbb66eb5b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:52.836976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-83cb94a5-0148-442d-87d1-53ccbb66eb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:52.866401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:52.903411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 653/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:52.926451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f788f1-69e7-4330-984d-476f2823af49 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:52.957659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:53.026967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f788f1-69e7-4330-984d-476f2823af49 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:53.060170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebfc08-3c9b-4b15-836b-8f12f4d44afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:53.060821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebfc08-3c9b-4b15-836b-8f12f4d44afd None admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:53.061108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebfc08-3c9b-4b15-836b-8f12f4d44afd None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:53.061388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebfc08-3c9b-4b15-836b-8f12f4d44afd None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:53.062112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebfc08-3c9b-4b15-836b-8f12f4d44afd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:53.063529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebfc08-3c9b-4b15-836b-8f12f4d44afd None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:53.076051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 642/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu May 26 20:02:52 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:02:55.244776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c24ae-0045-456d-bef8-16e44fd7d81c None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:55.245333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c24ae-0045-456d-bef8-16e44fd7d81c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:55.245333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106c24ae-0045-456d-bef8-16e44fd7d81c None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:55.246658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 654/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:55.252424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e6a01-f75b-4598-b3ee-e6a9f0f2ffc8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:55.252808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e6a01-f75b-4598-b3ee-e6a9f0f2ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:55.252992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e6a01-f75b-4598-b3ee-e6a9f0f2ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:55.269458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9b5e6a01-f75b-4598-b3ee-e6a9f0f2ffc8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:55.270640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9b5e6a01-f75b-4598-b3ee-e6a9f0f2ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:55.340491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 643/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:55 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:55.363023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c24ae-0045-456d-bef8-16e44fd7d81c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:55.469672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106c24ae-0045-456d-bef8-16e44fd7d81c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:55.502883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:55.503620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:55.503905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:55.504177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:55.504816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:55.506192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:55.517776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:55.519002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:55.519846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 655/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 20:02:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 20:02:55.525243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e6a01-f75b-4598-b3ee-e6a9f0f2ffc8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:55.543091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:55.622148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e6a01-f75b-4598-b3ee-e6a9f0f2ffc8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:55.654772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:55.655459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:55.655742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:55.656017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:55.657257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:55.657572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:55.658948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:55.663957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 644/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 20:02:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:55.669895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:55.701047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:55.767319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6040a-f669-4051-a8d1-9a0ea9b69247 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:55.800818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad3674-5b27-4ddd-b8e7-49a0b6a8d149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:55.801483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3674-5b27-4ddd-b8e7-49a0b6a8d149 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:55.803506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3674-5b27-4ddd-b8e7-49a0b6a8d149 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:55.803791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad3674-5b27-4ddd-b8e7-49a0b6a8d149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:55.805723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad3674-5b27-4ddd-b8e7-49a0b6a8d149 None admin] RBAC: Adding query filter params (interface=public, service_id=055db27865e4466baa6c76993c2e786f, region_id=RegionOne) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:55.805723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad3674-5b27-4ddd-b8e7-49a0b6a8d149 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:55.806263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad3674-5b27-4ddd-b8e7-49a0b6a8d149 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:55.813890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 656/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu May 26 20:02:55 2022] GET /identity/v3/endpoints?service_id=055db27865e4466baa6c76993c2e786f&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:55.819828 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:55.902873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:55.921100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62236c3-5333-45e6-b107-f859c1877cef None admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:55.955587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39effce2-d737-45b2-999b-4fff12ec8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:55.956245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39effce2-d737-45b2-999b-4fff12ec8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:55.956530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39effce2-d737-45b2-999b-4fff12ec8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:55.956808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39effce2-d737-45b2-999b-4fff12ec8fa4 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:55.957483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39effce2-d737-45b2-999b-4fff12ec8fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:55.958864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39effce2-d737-45b2-999b-4fff12ec8fa4 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:55.965484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 645/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu May 26 20:02:55 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:02:58.116277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c563-c383-4680-b861-9ddcc4b4a5e1 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:58.116828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c563-c383-4680-b861-9ddcc4b4a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:58.116828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9c563-c383-4680-b861-9ddcc4b4a5e1 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:58.118191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 657/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:02:58.123224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f3028-3dd0-495a-b1a8-a7982fbd2f4c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:58.123614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f3028-3dd0-495a-b1a8-a7982fbd2f4c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:58.123779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f3028-3dd0-495a-b1a8-a7982fbd2f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:58.141168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d58f3028-3dd0-495a-b1a8-a7982fbd2f4c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:02:58.142333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d58f3028-3dd0-495a-b1a8-a7982fbd2f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:02:58.211415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 646/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:02:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 20:02:58.233371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9c563-c383-4680-b861-9ddcc4b4a5e1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:58.326329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:58.333314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9c563-c383-4680-b861-9ddcc4b4a5e1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:58.365770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:58.366604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:58.366856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:58.367143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:58.367786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:58.369147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 20:02:58.381422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 20:02:58.382572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.get_or_create( May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application with Lock( May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self._enter() May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application return self.creator() May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application created_value = creator( May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: ERROR keystone.server.flask.application May 26 20:02:58.383710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 658/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu May 26 20:02:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 20:02:58.388701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f3028-3dd0-495a-b1a8-a7982fbd2f4c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:58.462806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:02:58.485691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f3028-3dd0-495a-b1a8-a7982fbd2f4c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:58.518177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cb8d6-6c5c-4174-b562-856d5e9914a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:58.518832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cb8d6-6c5c-4174-b562-856d5e9914a8 None admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:58.519146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cb8d6-6c5c-4174-b562-856d5e9914a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:58.519425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cb8d6-6c5c-4174-b562-856d5e9914a8 None admin] PATH_INFO: `/v3/services` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:58.520127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cb8d6-6c5c-4174-b562-856d5e9914a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:02:58.520434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cb8d6-6c5c-4174-b562-856d5e9914a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:58.521790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cb8d6-6c5c-4174-b562-856d5e9914a8 None admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:58.526769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 647/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu May 26 20:02:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:02:58.532425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:02:58.629169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5875f421-c1c2-4d9f-ac7d-3a0f08e32e59 None admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:02:58.665566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8f594-6062-4e37-9466-86ebbe9a1a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:02:58.666214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8f594-6062-4e37-9466-86ebbe9a1a98 None admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:02:58.666498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8f594-6062-4e37-9466-86ebbe9a1a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:02:58.666774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8f594-6062-4e37-9466-86ebbe9a1a98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:02:58.667532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8f594-6062-4e37-9466-86ebbe9a1a98 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:02:58.668894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8f594-6062-4e37-9466-86ebbe9a1a98 None admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:02:58.687045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 659/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu May 26 20:02:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:03:08.523887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=30 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:03:08.682668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:02.528022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce75fc9-d395-460f-9598-e15fba188103 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:02.528591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce75fc9-d395-460f-9598-e15fba188103 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:02.528591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce75fc9-d395-460f-9598-e15fba188103 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:02.535630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e70c6-4fb0-467d-8411-5191b93f1120 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:02.536078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e70c6-4fb0-467d-8411-5191b93f1120 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:02.536169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e70c6-4fb0-467d-8411-5191b93f1120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:02.539933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 648/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:02.645664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4e8e70c6-4fb0-467d-8411-5191b93f1120 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:02.646920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4e8e70c6-4fb0-467d-8411-5191b93f1120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:02.890456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 660/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:04:02.936857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22b5f-6d5a-4ec9-978f-60156f47fdaa None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:02.937465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22b5f-6d5a-4ec9-978f-60156f47fdaa None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:02.938210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa22b5f-6d5a-4ec9-978f-60156f47fdaa None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:02.941388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 649/1309] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 26 20:04:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:02.948836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154495-59e3-4397-845d-5c5bd9d30aaa None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:02.949489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154495-59e3-4397-845d-5c5bd9d30aaa None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:02.950238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91154495-59e3-4397-845d-5c5bd9d30aaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:03.102510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-91154495-59e3-4397-845d-5c5bd9d30aaa None None] MFA Rules not processed for user `8751982010ae4b7eb6c855aea7540a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:03.104461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-91154495-59e3-4397-845d-5c5bd9d30aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:03.131808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:03.206345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 661/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 26 20:04:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:04:03.207458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22b5f-6d5a-4ec9-978f-60156f47fdaa None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:03.209394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2fa22b5f-6d5a-4ec9-978f-60156f47fdaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:03.366912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa22b5f-6d5a-4ec9-978f-60156f47fdaa None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:03.458959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f255e8c-ca89-497d-a367-a84c5bb21482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:03.459709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255e8c-ca89-497d-a367-a84c5bb21482 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:03.460108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255e8c-ca89-497d-a367-a84c5bb21482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:03.460487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f255e8c-ca89-497d-a367-a84c5bb21482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:03.462241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8f255e8c-ca89-497d-a367-a84c5bb21482 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:03.519791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:03.579782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255e8c-ca89-497d-a367-a84c5bb21482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:03.581731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f255e8c-ca89-497d-a367-a84c5bb21482 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:03.626486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 650/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:06.155880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054db1-8ca8-4f4d-ad8b-a46b491c76ab None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:06.156410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054db1-8ca8-4f4d-ad8b-a46b491c76ab None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:06.156530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b054db1-8ca8-4f4d-ad8b-a46b491c76ab None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:06.157805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 662/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:06.163047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e284-00ee-42f7-acaf-436c89733c5c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:06.163474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e284-00ee-42f7-acaf-436c89733c5c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:06.163609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e284-00ee-42f7-acaf-436c89733c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:06.243185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-21e2e284-00ee-42f7-acaf-436c89733c5c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:06.244391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-21e2e284-00ee-42f7-acaf-436c89733c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:06.345534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 651/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:06.382775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054db1-8ca8-4f4d-ad8b-a46b491c76ab None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:06.384412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1b054db1-8ca8-4f4d-ad8b-a46b491c76ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:06.492403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b054db1-8ca8-4f4d-ad8b-a46b491c76ab None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:06.565088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:06.567911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44420fc1-5a4b-4f9e-be95-ae81d056d64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:06.568709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44420fc1-5a4b-4f9e-be95-ae81d056d64c service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:06.569181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44420fc1-5a4b-4f9e-be95-ae81d056d64c service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:06.569455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44420fc1-5a4b-4f9e-be95-ae81d056d64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:06.571190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-44420fc1-5a4b-4f9e-be95-ae81d056d64c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:06.688676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44420fc1-5a4b-4f9e-be95-ae81d056d64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:06.690376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44420fc1-5a4b-4f9e-be95-ae81d056d64c service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:06.708537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 663/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:09.214423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e2529-9412-4739-886e-c82bad28cdb9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:09.214989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e2529-9412-4739-886e-c82bad28cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:09.215109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e2529-9412-4739-886e-c82bad28cdb9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:09.216904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 652/1315] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:09.221970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76507a9-e8d9-4337-9e51-190cc94ac45d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:09.222370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76507a9-e8d9-4337-9e51-190cc94ac45d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:09.222585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76507a9-e8d9-4337-9e51-190cc94ac45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:09.285718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b76507a9-e8d9-4337-9e51-190cc94ac45d None None] MFA Rules not processed for user `ba19132a5049407ea836cbcaf73d3258`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:09.286958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b76507a9-e8d9-4337-9e51-190cc94ac45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:09.337249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:09.384081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 664/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:09.423463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e2529-9412-4739-886e-c82bad28cdb9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:09.424997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-831e2529-9412-4739-886e-c82bad28cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:09.434767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:09.528224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e2529-9412-4739-886e-c82bad28cdb9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:09.600511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a13dad-3794-47d2-8664-aa1ef5e2fa2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:09.601148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13dad-3794-47d2-8664-aa1ef5e2fa2a service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:09.601425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13dad-3794-47d2-8664-aa1ef5e2fa2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:09.601695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a13dad-3794-47d2-8664-aa1ef5e2fa2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:09.603338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-26a13dad-3794-47d2-8664-aa1ef5e2fa2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:09.664326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:09.710469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13dad-3794-47d2-8664-aa1ef5e2fa2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:09.711922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a13dad-3794-47d2-8664-aa1ef5e2fa2a service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:09.731846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 653/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:09 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:12.513255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c1953-a2a1-46e7-a851-c3f30921c170 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:12.513785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c1953-a2a1-46e7-a851-c3f30921c170 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:12.513923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c1953-a2a1-46e7-a851-c3f30921c170 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:12.515216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 665/1318] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:12.520742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7e0c-66ef-4634-ae0a-fdb97d479050 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:12.521240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7e0c-66ef-4634-ae0a-fdb97d479050 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:12.521334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea7e0c-66ef-4634-ae0a-fdb97d479050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:12.584439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e6ea7e0c-66ef-4634-ae0a-fdb97d479050 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:12.585550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e6ea7e0c-66ef-4634-ae0a-fdb97d479050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:12.680370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 654/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:12.735654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c1953-a2a1-46e7-a851-c3f30921c170 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:12.737228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-263c1953-a2a1-46e7-a851-c3f30921c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:12.838243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c1953-a2a1-46e7-a851-c3f30921c170 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:12.909344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf8604-2829-4fbd-beb8-1ff5524cc77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:12.909982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf8604-2829-4fbd-beb8-1ff5524cc77e service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:12.910265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf8604-2829-4fbd-beb8-1ff5524cc77e service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:12.910547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf8604-2829-4fbd-beb8-1ff5524cc77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:12.912198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4dbf8604-2829-4fbd-beb8-1ff5524cc77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:12.919470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:13.018915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf8604-2829-4fbd-beb8-1ff5524cc77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:13.020355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf8604-2829-4fbd-beb8-1ff5524cc77e service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:13.042869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 666/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:15.949758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28ab8a-4515-4f7e-a1ac-cf6d104d3155 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:15.950276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28ab8a-4515-4f7e-a1ac-cf6d104d3155 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:15.950276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28ab8a-4515-4f7e-a1ac-cf6d104d3155 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:15.952248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 655/1321] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:15.957547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590220d9-1c0e-4089-a658-b407a8a69243 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:15.957975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590220d9-1c0e-4089-a658-b407a8a69243 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:15.958100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590220d9-1c0e-4089-a658-b407a8a69243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:16.022333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-590220d9-1c0e-4089-a658-b407a8a69243 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:16.023546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-590220d9-1c0e-4089-a658-b407a8a69243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:16.081692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:16.119407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 667/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:16.155291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28ab8a-4515-4f7e-a1ac-cf6d104d3155 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:16.156904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-af28ab8a-4515-4f7e-a1ac-cf6d104d3155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:16.176002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:16.260928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28ab8a-4515-4f7e-a1ac-cf6d104d3155 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:16.333945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf28b68-b5dd-48f7-96ae-a538ff8279d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:16.334596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28b68-b5dd-48f7-96ae-a538ff8279d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:16.334972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28b68-b5dd-48f7-96ae-a538ff8279d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:16.335256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf28b68-b5dd-48f7-96ae-a538ff8279d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:16.336896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-edf28b68-b5dd-48f7-96ae-a538ff8279d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:16.411585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:16.451263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28b68-b5dd-48f7-96ae-a538ff8279d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:16.452737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf28b68-b5dd-48f7-96ae-a538ff8279d5 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:16.472112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 656/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:18.729915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29aa67-8b7a-47e0-ad5f-31ede1be8892 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:18.730434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29aa67-8b7a-47e0-ad5f-31ede1be8892 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:18.730552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29aa67-8b7a-47e0-ad5f-31ede1be8892 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:18.731931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 668/1324] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:18.737624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3fcc-67d9-4250-b496-30bbc3a5ec33 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:18.738050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3fcc-67d9-4250-b496-30bbc3a5ec33 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:18.738188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd3fcc-67d9-4250-b496-30bbc3a5ec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:18.806425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4bcd3fcc-67d9-4250-b496-30bbc3a5ec33 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:18.807668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4bcd3fcc-67d9-4250-b496-30bbc3a5ec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:18.904459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 657/1325] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:18.939811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29aa67-8b7a-47e0-ad5f-31ede1be8892 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:18.941383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2e29aa67-8b7a-47e0-ad5f-31ede1be8892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:19.046073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29aa67-8b7a-47e0-ad5f-31ede1be8892 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:19.134943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31125e8-459c-480c-8c80-9f8d5525cac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:19.135586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31125e8-459c-480c-8c80-9f8d5525cac2 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:19.135864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31125e8-459c-480c-8c80-9f8d5525cac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:19.136133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31125e8-459c-480c-8c80-9f8d5525cac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:19.137750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b31125e8-459c-480c-8c80-9f8d5525cac2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:19.154895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:19.249250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31125e8-459c-480c-8c80-9f8d5525cac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:19.250692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31125e8-459c-480c-8c80-9f8d5525cac2 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:19.268551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 669/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:21.524323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde9e2-26e0-4302-bcc1-1d16eff31f56 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:21.524886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde9e2-26e0-4302-bcc1-1d16eff31f56 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:21.524886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdde9e2-26e0-4302-bcc1-1d16eff31f56 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:21.526258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 658/1327] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:21.532017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7d2f-e4d9-4c44-8066-f508a182dbfb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:21.532400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7d2f-e4d9-4c44-8066-f508a182dbfb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:21.532653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c7d2f-e4d9-4c44-8066-f508a182dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:21.597974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-026c7d2f-e4d9-4c44-8066-f508a182dbfb None None] MFA Rules not processed for user `ba19132a5049407ea836cbcaf73d3258`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:21.599227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-026c7d2f-e4d9-4c44-8066-f508a182dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:21.669673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:21.702701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 670/1328] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:21.739448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde9e2-26e0-4302-bcc1-1d16eff31f56 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:21.740984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4bdde9e2-26e0-4302-bcc1-1d16eff31f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:21.776274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:21.858326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdde9e2-26e0-4302-bcc1-1d16eff31f56 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:21.931137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04357a-e00b-4131-9dfd-5fd27857d94a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:21.931789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04357a-e00b-4131-9dfd-5fd27857d94a service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:21.932076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04357a-e00b-4131-9dfd-5fd27857d94a service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:21.932358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04357a-e00b-4131-9dfd-5fd27857d94a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:21.934010 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8f04357a-e00b-4131-9dfd-5fd27857d94a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:22.011378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:22.043807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04357a-e00b-4131-9dfd-5fd27857d94a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:22.045199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04357a-e00b-4131-9dfd-5fd27857d94a service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:22.070007 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 659/1329] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:24.507859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08a447-c390-433c-b8ca-655d93c82ad2 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:24.508366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08a447-c390-433c-b8ca-655d93c82ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:24.508482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08a447-c390-433c-b8ca-655d93c82ad2 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:24.509825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 671/1330] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:24.515476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f373c0-204c-4213-8ccb-12bf9ebb96de None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:24.515945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f373c0-204c-4213-8ccb-12bf9ebb96de None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:24.516037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f373c0-204c-4213-8ccb-12bf9ebb96de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:24.587934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c1f373c0-204c-4213-8ccb-12bf9ebb96de None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:24.588681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c1f373c0-204c-4213-8ccb-12bf9ebb96de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:24.705114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 660/1331] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:24.755923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4097e-3186-4f4f-b964-2c06a4dc9ca2 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:24.756135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4097e-3186-4f4f-b964-2c06a4dc9ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:24.756414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4097e-3186-4f4f-b964-2c06a4dc9ca2 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:24.757807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 672/1332] 10.222.0.48 () {54 vars in 964 bytes} [Thu May 26 20:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:24.763724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bb6d3-6290-466b-b8a7-94701bb54556 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:24.764088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bb6d3-6290-466b-b8a7-94701bb54556 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:24.764378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bb6d3-6290-466b-b8a7-94701bb54556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:24.807882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:24.839252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-af3bb6d3-6290-466b-b8a7-94701bb54556 None None] MFA Rules not processed for user `8751982010ae4b7eb6c855aea7540a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:24.840454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-af3bb6d3-6290-466b-b8a7-94701bb54556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:24.918599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 661/1333] 10.222.0.48 () {58 vars in 1061 bytes} [Thu May 26 20:04:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:24.928249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4097e-3186-4f4f-b964-2c06a4dc9ca2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:24.929811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f2f4097e-3186-4f4f-b964-2c06a4dc9ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:25.035646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4097e-3186-4f4f-b964-2c06a4dc9ca2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:25.112477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb434fcb-0cf5-40b7-918b-073c4b2e28c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:25.113127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb434fcb-0cf5-40b7-918b-073c4b2e28c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:25.113409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb434fcb-0cf5-40b7-918b-073c4b2e28c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:25.113681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb434fcb-0cf5-40b7-918b-073c4b2e28c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:25.115360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-eb434fcb-0cf5-40b7-918b-073c4b2e28c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:25.142525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:25.225375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb434fcb-0cf5-40b7-918b-073c4b2e28c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:25.226818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb434fcb-0cf5-40b7-918b-073c4b2e28c3 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:25.244486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 673/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:27.689363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68afc2b-91cd-4e58-a5a4-8bee68826efd None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:27.689887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68afc2b-91cd-4e58-a5a4-8bee68826efd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:27.689980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68afc2b-91cd-4e58-a5a4-8bee68826efd None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:27.691361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 662/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:27.696579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9e8ad-2b6a-430a-85ce-3c09c39ae329 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:27.697019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9e8ad-2b6a-430a-85ce-3c09c39ae329 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:27.697117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9e8ad-2b6a-430a-85ce-3c09c39ae329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:27.759849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1fc9e8ad-2b6a-430a-85ce-3c09c39ae329 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:27.761036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1fc9e8ad-2b6a-430a-85ce-3c09c39ae329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:27.832985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:27.855068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 674/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:27.894485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68afc2b-91cd-4e58-a5a4-8bee68826efd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:27.896048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d68afc2b-91cd-4e58-a5a4-8bee68826efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:27.997408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68afc2b-91cd-4e58-a5a4-8bee68826efd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:28.025232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:28.070286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d33df7-22d0-4887-b813-2a48de4bc39e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:28.070986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d33df7-22d0-4887-b813-2a48de4bc39e service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:28.071279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d33df7-22d0-4887-b813-2a48de4bc39e service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:28.071558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d33df7-22d0-4887-b813-2a48de4bc39e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:28.073269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-83d33df7-22d0-4887-b813-2a48de4bc39e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:28.194148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d33df7-22d0-4887-b813-2a48de4bc39e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:28.195560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d33df7-22d0-4887-b813-2a48de4bc39e service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:28.214116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 663/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:31.038980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4e31f-efc5-49c1-8d19-ccf77069d373 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:31.039489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4e31f-efc5-49c1-8d19-ccf77069d373 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:31.039489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4e31f-efc5-49c1-8d19-ccf77069d373 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:31.040912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 675/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:31.046757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850170a-54b4-4915-88a2-3d17aad6b1ed None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:31.047211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850170a-54b4-4915-88a2-3d17aad6b1ed None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:31.047347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850170a-54b4-4915-88a2-3d17aad6b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:31.112435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7850170a-54b4-4915-88a2-3d17aad6b1ed None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:31.113630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7850170a-54b4-4915-88a2-3d17aad6b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:31.121850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:31.209991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 664/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:31.245547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4e31f-efc5-49c1-8d19-ccf77069d373 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:31.247103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a0a4e31f-efc5-49c1-8d19-ccf77069d373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:31.348388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4e31f-efc5-49c1-8d19-ccf77069d373 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:31.421493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630afabc-3e85-4789-a25c-11f21dea84a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:31.422162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afabc-3e85-4789-a25c-11f21dea84a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:31.422445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afabc-3e85-4789-a25c-11f21dea84a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:31.422723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630afabc-3e85-4789-a25c-11f21dea84a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:31.424400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-630afabc-3e85-4789-a25c-11f21dea84a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:31.459559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:31.532302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afabc-3e85-4789-a25c-11f21dea84a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:31.533719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630afabc-3e85-4789-a25c-11f21dea84a0 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:31.551109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 676/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:35.835119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342c534-8c0c-4bbd-b659-bc457442122a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:35.835699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342c534-8c0c-4bbd-b659-bc457442122a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:35.835699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342c534-8c0c-4bbd-b659-bc457442122a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:35.836989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 665/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:04:35.842170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a16da-2fca-44ea-aee9-b64b5a07e078 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:35.842627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a16da-2fca-44ea-aee9-b64b5a07e078 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:35.842733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a16da-2fca-44ea-aee9-b64b5a07e078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:35.912008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8a1a16da-2fca-44ea-aee9-b64b5a07e078 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:35.913216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8a1a16da-2fca-44ea-aee9-b64b5a07e078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:36.003468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:36.017039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 677/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:04:36.055665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342c534-8c0c-4bbd-b659-bc457442122a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:36.057875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c342c534-8c0c-4bbd-b659-bc457442122a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:36.156235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342c534-8c0c-4bbd-b659-bc457442122a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:36.159829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24560221-ae0a-4a0d-b3b2-336e913a67db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:36.160477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560221-ae0a-4a0d-b3b2-336e913a67db service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:36.160762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560221-ae0a-4a0d-b3b2-336e913a67db service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:36.161038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24560221-ae0a-4a0d-b3b2-336e913a67db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:36.171074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24560221-ae0a-4a0d-b3b2-336e913a67db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:36.172525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24560221-ae0a-4a0d-b3b2-336e913a67db service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:36.182070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 666/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:38.976753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a54b-f74d-41e8-b305-6f9348b20e59 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:38.977309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a54b-f74d-41e8-b305-6f9348b20e59 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:38.977309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297a54b-f74d-41e8-b305-6f9348b20e59 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:38.978564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 678/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:38.984514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b618-c4c2-4f2a-9b85-b057d541c740 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:38.984917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b618-c4c2-4f2a-9b85-b057d541c740 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:38.985079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b618-c4c2-4f2a-9b85-b057d541c740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:39.012956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0fe9b618-c4c2-4f2a-9b85-b057d541c740 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:39.014134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0fe9b618-c4c2-4f2a-9b85-b057d541c740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:39.041423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:39.092289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 667/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:39.128605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a54b-f74d-41e8-b305-6f9348b20e59 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:39.139019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297a54b-f74d-41e8-b305-6f9348b20e59 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:39.142418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74499b48-5992-44b3-8201-25593e0a5982 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:39.143080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499b48-5992-44b3-8201-25593e0a5982 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:39.143364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499b48-5992-44b3-8201-25593e0a5982 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:39.143635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74499b48-5992-44b3-8201-25593e0a5982 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:39.152358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74499b48-5992-44b3-8201-25593e0a5982 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:39.154290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74499b48-5992-44b3-8201-25593e0a5982 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:39.163425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 679/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:43.561809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40246-e9dd-4932-a0f5-a00fe23777ca None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:43.562310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40246-e9dd-4932-a0f5-a00fe23777ca None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:43.562591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd40246-e9dd-4932-a0f5-a00fe23777ca None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:43.565118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 668/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:43.570567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee4ee-d14b-4115-bdd8-f5b715f181c7 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:43.571020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee4ee-d14b-4115-bdd8-f5b715f181c7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:43.571181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ee4ee-d14b-4115-bdd8-f5b715f181c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:43.589553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ea7ee4ee-d14b-4115-bdd8-f5b715f181c7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:43.590747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ea7ee4ee-d14b-4115-bdd8-f5b715f181c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:43.599204 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 680/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:43.639407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40246-e9dd-4932-a0f5-a00fe23777ca None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:43.650038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd40246-e9dd-4932-a0f5-a00fe23777ca None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:43.653580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41426ba9-d8b0-45a1-bff7-c6e2dc6a7599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:43.654165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426ba9-d8b0-45a1-bff7-c6e2dc6a7599 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:43.654448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426ba9-d8b0-45a1-bff7-c6e2dc6a7599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:43.654724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41426ba9-d8b0-45a1-bff7-c6e2dc6a7599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:43.663493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41426ba9-d8b0-45a1-bff7-c6e2dc6a7599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:43.664915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41426ba9-d8b0-45a1-bff7-c6e2dc6a7599 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:43.674933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 669/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:04:49.097387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de92d-0283-4149-b873-0c505992c000 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:49.097387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de92d-0283-4149-b873-0c505992c000 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:49.097387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025de92d-0283-4149-b873-0c505992c000 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:49.099546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 681/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:04:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:49.105123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ebfb-24be-4d91-b264-2aac740a72bb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:49.105571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ebfb-24be-4d91-b264-2aac740a72bb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:49.105748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ebfb-24be-4d91-b264-2aac740a72bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:49.179625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5166ebfb-24be-4d91-b264-2aac740a72bb None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:49.180858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5166ebfb-24be-4d91-b264-2aac740a72bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:49.266139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 670/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:04:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:53.584421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=13 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:53.618731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3fb7-5651-429f-aaab-f3e6f006c395 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:53.619288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3fb7-5651-429f-aaab-f3e6f006c395 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:53.619565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c3fb7-5651-429f-aaab-f3e6f006c395 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:53.621122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 682/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:53.626945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34f796-d8bb-4fc2-a6fd-e75bee184d2a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:53.627755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34f796-d8bb-4fc2-a6fd-e75bee184d2a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:53.628192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34f796-d8bb-4fc2-a6fd-e75bee184d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:53.652177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9d34f796-d8bb-4fc2-a6fd-e75bee184d2a None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:53.654129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9d34f796-d8bb-4fc2-a6fd-e75bee184d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:53.663830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 671/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:04:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:55.103307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6fff7-463d-4499-97c7-35061f7ee9ed None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:55.103819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6fff7-463d-4499-97c7-35061f7ee9ed None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:55.103938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6fff7-463d-4499-97c7-35061f7ee9ed None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:55.105283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 683/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:55.112976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f9ce-3ca9-4e62-8145-e3429327f207 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:55.113414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f9ce-3ca9-4e62-8145-e3429327f207 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:55.113511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f9ce-3ca9-4e62-8145-e3429327f207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:55.132275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7f70f9ce-3ca9-4e62-8145-e3429327f207 None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:55.133486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7f70f9ce-3ca9-4e62-8145-e3429327f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:55.142526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 672/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:04:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:04:59.046238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c3e5-d1b2-442d-a62e-2d580333f77b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:59.046740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c3e5-d1b2-442d-a62e-2d580333f77b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:59.046740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7c3e5-d1b2-442d-a62e-2d580333f77b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:59.048293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 684/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:59.053284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b1e6-954e-47b1-8a55-9d24de0ee99b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:59.053671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b1e6-954e-47b1-8a55-9d24de0ee99b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:59.053842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517b1e6-954e-47b1-8a55-9d24de0ee99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:59.072996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0517b1e6-954e-47b1-8a55-9d24de0ee99b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:59.074181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0517b1e6-954e-47b1-8a55-9d24de0ee99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:59.082562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 673/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:04:59.135599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691d060-4b6e-4e0d-ae24-3f0e45938feb None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:59.136132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691d060-4b6e-4e0d-ae24-3f0e45938feb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:59.136622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691d060-4b6e-4e0d-ae24-3f0e45938feb None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:59.139141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 685/1358] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 20:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:04:59.149164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898c17-a00b-4c95-abd0-384f6dbe214a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:59.150557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898c17-a00b-4c95-abd0-384f6dbe214a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:59.151108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5898c17-a00b-4c95-abd0-384f6dbe214a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:59.195776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:04:59.204746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b5898c17-a00b-4c95-abd0-384f6dbe214a None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:04:59.206066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b5898c17-a00b-4c95-abd0-384f6dbe214a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:04:59.296908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 674/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 20:04:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:04:59.306735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691d060-4b6e-4e0d-ae24-3f0e45938feb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:04:59.323306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691d060-4b6e-4e0d-ae24-3f0e45938feb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:04:59.329385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47238e-dec7-44c8-a95d-03bd051f679a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:04:59.330034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47238e-dec7-44c8-a95d-03bd051f679a service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:04:59.330322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47238e-dec7-44c8-a95d-03bd051f679a service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:04:59.330601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47238e-dec7-44c8-a95d-03bd051f679a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:04:59.339586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47238e-dec7-44c8-a95d-03bd051f679a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:04:59.341754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47238e-dec7-44c8-a95d-03bd051f679a service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:04:59.351897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 686/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:05:01.806645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b399-92e0-452a-8b17-bf3e0a58685e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:01.807258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b399-92e0-452a-8b17-bf3e0a58685e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:01.807343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f043b399-92e0-452a-8b17-bf3e0a58685e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:01.808852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 675/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:01.814169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce783c6-afd3-489b-8810-a9795036e6d4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:01.814568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce783c6-afd3-489b-8810-a9795036e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:01.814728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce783c6-afd3-489b-8810-a9795036e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:01.833537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7ce783c6-afd3-489b-8810-a9795036e6d4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:01.834979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7ce783c6-afd3-489b-8810-a9795036e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:01.844208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 687/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:05:01.888432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b399-92e0-452a-8b17-bf3e0a58685e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:01.902774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f043b399-92e0-452a-8b17-bf3e0a58685e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:01.909326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769c20f-b1de-478c-b47f-98b44cac917a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:01.909978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769c20f-b1de-478c-b47f-98b44cac917a service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:01.910268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769c20f-b1de-478c-b47f-98b44cac917a service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:01.910549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769c20f-b1de-478c-b47f-98b44cac917a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:01.920521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769c20f-b1de-478c-b47f-98b44cac917a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:01.922125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6769c20f-b1de-478c-b47f-98b44cac917a service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:01.932405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 676/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:04.473179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69140-f793-4998-9e9d-a968ec70c6b3 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:04.473672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69140-f793-4998-9e9d-a968ec70c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:04.473788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69140-f793-4998-9e9d-a968ec70c6b3 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:04.475126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 688/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:04.480340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046f56-a03e-428d-9dc6-c9a7c59d8baf None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:04.480790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046f56-a03e-428d-9dc6-c9a7c59d8baf None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:04.480910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046f56-a03e-428d-9dc6-c9a7c59d8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:04.501267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b7046f56-a03e-428d-9dc6-c9a7c59d8baf None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:04.502463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b7046f56-a03e-428d-9dc6-c9a7c59d8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:04.510814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 677/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:04.560419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8fa29-ad53-4859-a86a-d765a0f17951 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:04.560968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8fa29-ad53-4859-a86a-d765a0f17951 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:04.561404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8fa29-ad53-4859-a86a-d765a0f17951 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:04.562950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 689/1366] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 20:05:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:04.569014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0802-67af-4fb5-a78f-e69358544aa2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:04.569274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0802-67af-4fb5-a78f-e69358544aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:04.569553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c0802-67af-4fb5-a78f-e69358544aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:04.587454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4c2c0802-67af-4fb5-a78f-e69358544aa2 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:04.588691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4c2c0802-67af-4fb5-a78f-e69358544aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:04.598653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 678/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 20:05:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:04.606112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8fa29-ad53-4859-a86a-d765a0f17951 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:04.620036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8fa29-ad53-4859-a86a-d765a0f17951 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:04.626068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f25681-283b-4923-b2c3-38bf93dd2513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:04.626712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25681-283b-4923-b2c3-38bf93dd2513 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:04.627026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25681-283b-4923-b2c3-38bf93dd2513 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:04.627533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f25681-283b-4923-b2c3-38bf93dd2513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:04.636036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25681-283b-4923-b2c3-38bf93dd2513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:04.638230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f25681-283b-4923-b2c3-38bf93dd2513 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:04.647535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 690/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:05:06.929533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f478-7514-4927-9471-0b1f4df0b0e5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:06.930087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f478-7514-4927-9471-0b1f4df0b0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:06.930087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e7f478-7514-4927-9471-0b1f4df0b0e5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:06.931407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 679/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:06.937025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48a8c0-b2fc-49d7-8ee3-dcbb1c1bf1bd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:06.937805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48a8c0-b2fc-49d7-8ee3-dcbb1c1bf1bd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:06.938084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48a8c0-b2fc-49d7-8ee3-dcbb1c1bf1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:06.957384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fc48a8c0-b2fc-49d7-8ee3-dcbb1c1bf1bd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:06.958560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fc48a8c0-b2fc-49d7-8ee3-dcbb1c1bf1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:06.967362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 691/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:07.011401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f478-7514-4927-9471-0b1f4df0b0e5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:07.029439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e7f478-7514-4927-9471-0b1f4df0b0e5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:07.035387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b12b9-a535-4be9-9e14-cd51e6f13c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:07.036248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b12b9-a535-4be9-9e14-cd51e6f13c09 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:07.036661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b12b9-a535-4be9-9e14-cd51e6f13c09 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:07.037039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b12b9-a535-4be9-9e14-cd51e6f13c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:07.046589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b12b9-a535-4be9-9e14-cd51e6f13c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:07.048378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b12b9-a535-4be9-9e14-cd51e6f13c09 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:07.058809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 680/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:07.289773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef45f-db17-4433-ad28-0ac3e5acf8fa None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:07.289993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef45f-db17-4433-ad28-0ac3e5acf8fa None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:07.290226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef45f-db17-4433-ad28-0ac3e5acf8fa None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:07.291869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 692/1372] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:07.297984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdfbe4-cad3-4431-91ad-a73f46db9c65 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:07.298423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdfbe4-cad3-4431-91ad-a73f46db9c65 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:07.298819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdfbe4-cad3-4431-91ad-a73f46db9c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:07.321265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2cbdfbe4-cad3-4431-91ad-a73f46db9c65 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:07.322966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2cbdfbe4-cad3-4431-91ad-a73f46db9c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:07.332295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 681/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:07.642807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe106441-6fba-4550-852b-5e35611c06e0 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:07.643640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe106441-6fba-4550-852b-5e35611c06e0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:07.644035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe106441-6fba-4550-852b-5e35611c06e0 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:07.645535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 693/1374] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 26 20:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:07.651949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47da25-b373-45a3-94a2-e3249e31b32f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:07.652245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47da25-b373-45a3-94a2-e3249e31b32f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:07.652554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d47da25-b373-45a3-94a2-e3249e31b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:07.702921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0d47da25-b373-45a3-94a2-e3249e31b32f None None] MFA Rules not processed for user `4225e82ea268483daa86078abb11c7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:07.704187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0d47da25-b373-45a3-94a2-e3249e31b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:07.767069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 682/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 26 20:05:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:07.774228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe106441-6fba-4550-852b-5e35611c06e0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:07.785562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe106441-6fba-4550-852b-5e35611c06e0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:07.789423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6a999-2f01-4785-8b08-eebe38323c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:07.790181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a999-2f01-4785-8b08-eebe38323c8f service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:07.790565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a999-2f01-4785-8b08-eebe38323c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:07.790976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6a999-2f01-4785-8b08-eebe38323c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:07.801515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6a999-2f01-4785-8b08-eebe38323c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:07.803081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6a999-2f01-4785-8b08-eebe38323c8f service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:07.813341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 694/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:05:09.347659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8c2c1-b8c3-4999-b3ab-e9402f255457 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:09.348275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8c2c1-b8c3-4999-b3ab-e9402f255457 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:09.348275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8c2c1-b8c3-4999-b3ab-e9402f255457 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:09.349660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 683/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:09.355675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6293a1-7939-411f-ab54-3fe489ee104f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:09.356786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6293a1-7939-411f-ab54-3fe489ee104f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:09.356883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6293a1-7939-411f-ab54-3fe489ee104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:09.376490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5e6293a1-7939-411f-ab54-3fe489ee104f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:09.377741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5e6293a1-7939-411f-ab54-3fe489ee104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:09.385925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 695/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:09.431481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8c2c1-b8c3-4999-b3ab-e9402f255457 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:09.446592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8c2c1-b8c3-4999-b3ab-e9402f255457 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:09.452819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b1a9d-5be1-489b-8137-30614414b3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:09.453504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1a9d-5be1-489b-8137-30614414b3e6 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:09.453792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1a9d-5be1-489b-8137-30614414b3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:09.454074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b1a9d-5be1-489b-8137-30614414b3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:09.463382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b1a9d-5be1-489b-8137-30614414b3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:09.465013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b1a9d-5be1-489b-8137-30614414b3e6 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:09.470091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:05:09.477127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 684/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:11.742650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56a5e-81bb-4487-8052-0ad30a7c01ea None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:11.743238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56a5e-81bb-4487-8052-0ad30a7c01ea None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:11.743238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c56a5e-81bb-4487-8052-0ad30a7c01ea None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:11.744597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 696/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:11.750607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a99e2-7852-422d-a281-f54b391421b5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:11.751100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a99e2-7852-422d-a281-f54b391421b5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:11.751214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a99e2-7852-422d-a281-f54b391421b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:11.770019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6b3a99e2-7852-422d-a281-f54b391421b5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:11.772759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6b3a99e2-7852-422d-a281-f54b391421b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:11.782911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 685/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:11.825351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c56a5e-81bb-4487-8052-0ad30a7c01ea None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:11.841683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c56a5e-81bb-4487-8052-0ad30a7c01ea None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:11.847156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ed4a9-6480-4115-9a60-85c2e86b8976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:11.847916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed4a9-6480-4115-9a60-85c2e86b8976 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:11.848324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed4a9-6480-4115-9a60-85c2e86b8976 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:11.848701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ed4a9-6480-4115-9a60-85c2e86b8976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:11.857700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed4a9-6480-4115-9a60-85c2e86b8976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:11.859470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27ed4a9-6480-4115-9a60-85c2e86b8976 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:11.869662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 697/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:14.120825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbc60-b8a7-449b-af1f-a13a42aeb149 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:14.121353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbc60-b8a7-449b-af1f-a13a42aeb149 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:14.121353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4fbc60-b8a7-449b-af1f-a13a42aeb149 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:14.123561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 686/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:14.128744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53146f-a02b-45d4-89fc-cb66e2d5a49f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:14.129170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53146f-a02b-45d4-89fc-cb66e2d5a49f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:14.129301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53146f-a02b-45d4-89fc-cb66e2d5a49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:14.146979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7f53146f-a02b-45d4-89fc-cb66e2d5a49f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:14.148162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7f53146f-a02b-45d4-89fc-cb66e2d5a49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:14.156473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 698/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:14.198004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fbc60-b8a7-449b-af1f-a13a42aeb149 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:14.212299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4fbc60-b8a7-449b-af1f-a13a42aeb149 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:14.217808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe1bb3-ad79-4a0c-981a-031f81a0bf48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:14.218449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1bb3-ad79-4a0c-981a-031f81a0bf48 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:14.218735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1bb3-ad79-4a0c-981a-031f81a0bf48 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:14.219039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe1bb3-ad79-4a0c-981a-031f81a0bf48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:14.227404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe1bb3-ad79-4a0c-981a-031f81a0bf48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:14.228980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe1bb3-ad79-4a0c-981a-031f81a0bf48 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:14.239517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 687/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:16.616274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3e83-d139-43fe-b724-94e524355e03 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:16.616854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3e83-d139-43fe-b724-94e524355e03 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:16.616964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3e83-d139-43fe-b724-94e524355e03 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:16.618281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 699/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:16.624024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135543f0-079e-41fe-aaf1-97cdcff9122d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:16.624493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135543f0-079e-41fe-aaf1-97cdcff9122d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:16.624692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135543f0-079e-41fe-aaf1-97cdcff9122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:16.642682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-135543f0-079e-41fe-aaf1-97cdcff9122d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:16.643910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-135543f0-079e-41fe-aaf1-97cdcff9122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:16.651682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 688/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:16.707626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3e83-d139-43fe-b724-94e524355e03 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:16.723342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3e83-d139-43fe-b724-94e524355e03 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:16.728859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59ca6b-6357-4dd6-bc74-97582c795445 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:16.729520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59ca6b-6357-4dd6-bc74-97582c795445 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:16.729800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59ca6b-6357-4dd6-bc74-97582c795445 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:16.730073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59ca6b-6357-4dd6-bc74-97582c795445 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:16.740145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59ca6b-6357-4dd6-bc74-97582c795445 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:16.741747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59ca6b-6357-4dd6-bc74-97582c795445 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:16.754942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 700/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:05:19.755180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f564fe-c2c6-49d0-be42-b10bea3b2f93 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:19.755724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f564fe-c2c6-49d0-be42-b10bea3b2f93 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:19.755917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f564fe-c2c6-49d0-be42-b10bea3b2f93 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:19.758156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 689/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:19.764002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e519d-def9-49f8-b577-e969a3b455c9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:19.764424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e519d-def9-49f8-b577-e969a3b455c9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:19.764716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e519d-def9-49f8-b577-e969a3b455c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:19.785811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fa5e519d-def9-49f8-b577-e969a3b455c9 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:19.787195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fa5e519d-def9-49f8-b577-e969a3b455c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:19.795983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 701/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:19.842596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f564fe-c2c6-49d0-be42-b10bea3b2f93 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:19.857732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f564fe-c2c6-49d0-be42-b10bea3b2f93 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:19.863168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba87143-2ffe-431f-9c82-407f8128978c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:19.863813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87143-2ffe-431f-9c82-407f8128978c service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:19.864101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87143-2ffe-431f-9c82-407f8128978c service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:19.864380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba87143-2ffe-431f-9c82-407f8128978c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:19.873368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87143-2ffe-431f-9c82-407f8128978c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:19.875051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba87143-2ffe-431f-9c82-407f8128978c service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:19.885316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 690/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:22.146086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222a85-09b7-4b5e-8a51-04a5129d6a77 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:22.146696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222a85-09b7-4b5e-8a51-04a5129d6a77 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:22.146696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d222a85-09b7-4b5e-8a51-04a5129d6a77 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:22.148024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 702/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:22.153487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955a9d-f8b9-4110-bdec-56d046d6f4f0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:22.153925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955a9d-f8b9-4110-bdec-56d046d6f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:22.154057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91955a9d-f8b9-4110-bdec-56d046d6f4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:22.172290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-91955a9d-f8b9-4110-bdec-56d046d6f4f0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:22.173486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-91955a9d-f8b9-4110-bdec-56d046d6f4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:22.181199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 691/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:22.225019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d222a85-09b7-4b5e-8a51-04a5129d6a77 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:22.239990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d222a85-09b7-4b5e-8a51-04a5129d6a77 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:22.245885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ef399-668d-4c50-932f-c1f0c4cfb939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:22.247136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef399-668d-4c50-932f-c1f0c4cfb939 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:22.247408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef399-668d-4c50-932f-c1f0c4cfb939 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:22.247681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ef399-668d-4c50-932f-c1f0c4cfb939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:22.255832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ef399-668d-4c50-932f-c1f0c4cfb939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:22.257389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ef399-668d-4c50-932f-c1f0c4cfb939 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:22.266640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 703/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:23.551803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445b24-a834-476c-9bb3-f942de08ec3e None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:23.552401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445b24-a834-476c-9bb3-f942de08ec3e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:23.552401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445b24-a834-476c-9bb3-f942de08ec3e None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:23.553741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 692/1395] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:23.559216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8689-f93c-45a4-b458-b757de52dab9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:23.559685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8689-f93c-45a4-b458-b757de52dab9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:23.559797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b8689-f93c-45a4-b458-b757de52dab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:23.577996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c51b8689-f93c-45a4-b458-b757de52dab9 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:23.579221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c51b8689-f93c-45a4-b458-b757de52dab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:23.586928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 704/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:05:23.643566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa151c7d-5a01-41e2-8f1a-4eb993cf91d5 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:23.643863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa151c7d-5a01-41e2-8f1a-4eb993cf91d5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:23.644145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa151c7d-5a01-41e2-8f1a-4eb993cf91d5 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:23.645523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 693/1397] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 26 20:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:23.650655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94880-c302-4982-98e1-52fe05ddd2c3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:23.650979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94880-c302-4982-98e1-52fe05ddd2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:23.651258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe94880-c302-4982-98e1-52fe05ddd2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:23.657543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=55 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:05:23.701896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-afe94880-c302-4982-98e1-52fe05ddd2c3 None None] MFA Rules not processed for user `8376ffaa09e2496a80fa60c979769d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:23.703148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-afe94880-c302-4982-98e1-52fe05ddd2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:23.761086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 705/1398] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 26 20:05:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:23.769096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa151c7d-5a01-41e2-8f1a-4eb993cf91d5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:23.780330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa151c7d-5a01-41e2-8f1a-4eb993cf91d5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:23.784145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c82e-6b54-41b1-872f-ed69fc0f72b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8376ffaa09e2496a80fa60c979769d8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:23.784794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c82e-6b54-41b1-872f-ed69fc0f72b8 service glance] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:23.785123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c82e-6b54-41b1-872f-ed69fc0f72b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:23.785511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c82e-6b54-41b1-872f-ed69fc0f72b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:23.794931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659c82e-6b54-41b1-872f-ed69fc0f72b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:23.796390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659c82e-6b54-41b1-872f-ed69fc0f72b8 service glance] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:23.805799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 694/1399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:24.330675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c982e6d-60d9-4ad9-9ab5-019e3e814d01 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:24.331012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c982e6d-60d9-4ad9-9ab5-019e3e814d01 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:24.331300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c982e6d-60d9-4ad9-9ab5-019e3e814d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:24.386588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9c982e6d-60d9-4ad9-9ab5-019e3e814d01 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:24.388406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9c982e6d-60d9-4ad9-9ab5-019e3e814d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:24.452577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 706/1400] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:24.497102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12d44-c738-46c8-b654-7c8c5186d476 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:24.497418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12d44-c738-46c8-b654-7c8c5186d476 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:24.497728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd12d44-c738-46c8-b654-7c8c5186d476 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:24.499157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 695/1401] 10.222.0.48 () {54 vars in 942 bytes} [Thu May 26 20:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:24.501131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a007-2677-4e4b-8ce3-ea091c23ad37 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:24.501429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a007-2677-4e4b-8ce3-ea091c23ad37 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:24.501529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a007-2677-4e4b-8ce3-ea091c23ad37 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:24.502849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 707/1402] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:24.505238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04983f80-3415-4505-91b0-8240f08dd907 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:24.505637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04983f80-3415-4505-91b0-8240f08dd907 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:24.505915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04983f80-3415-4505-91b0-8240f08dd907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:24.507622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31935-335c-4548-a7f4-5b68488761f6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:24.507916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31935-335c-4548-a7f4-5b68488761f6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:24.508192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c31935-335c-4548-a7f4-5b68488761f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:24.525571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-49c31935-335c-4548-a7f4-5b68488761f6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:24.526779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-49c31935-335c-4548-a7f4-5b68488761f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:24.534807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 708/1403] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:05:24.558325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-04983f80-3415-4505-91b0-8240f08dd907 None None] MFA Rules not processed for user `b80af2efebf440959ceb238bd27cf7f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:24.560149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-04983f80-3415-4505-91b0-8240f08dd907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:24.579383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c31935-335c-4548-a7f4-5b68488761f6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:24.591877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c31935-335c-4548-a7f4-5b68488761f6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:24.598057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:24.598691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:24.599011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:24.599287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:24.608527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:24.610117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:24.619819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 709/1404] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:05:24.635026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 696/1405] 10.222.0.48 () {58 vars in 1039 bytes} [Thu May 26 20:05:24 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:05:24.645251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:24.656199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9035d-e5c7-4647-9782-b1589a38194c service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:24.661445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc55cab-4a76-49f0-88da-2504ba6dda85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:24.662116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55cab-4a76-49f0-88da-2504ba6dda85 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:24.662397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55cab-4a76-49f0-88da-2504ba6dda85 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:24.662712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc55cab-4a76-49f0-88da-2504ba6dda85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:24.672270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc55cab-4a76-49f0-88da-2504ba6dda85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:24.674444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc55cab-4a76-49f0-88da-2504ba6dda85 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:24.683309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 710/1406] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:05:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:05:26.889566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4a9f-4133-4f8e-96b7-25688ab17bfb None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:26.890075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4a9f-4133-4f8e-96b7-25688ab17bfb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:26.890075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc4a9f-4133-4f8e-96b7-25688ab17bfb None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:26.891449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 697/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:05:26.896708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696e51-b9ea-4e9c-afa3-3f84b6c6c156 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:26.897132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696e51-b9ea-4e9c-afa3-3f84b6c6c156 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:26.897272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3696e51-b9ea-4e9c-afa3-3f84b6c6c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:26.916834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a3696e51-b9ea-4e9c-afa3-3f84b6c6c156 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:26.918042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a3696e51-b9ea-4e9c-afa3-3f84b6c6c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:26.926266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 711/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:26.970415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4a9f-4133-4f8e-96b7-25688ab17bfb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:26.984847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc4a9f-4133-4f8e-96b7-25688ab17bfb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:26.990461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0adcb4-8fb5-4b70-92c4-686b1ccef0df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:26.991244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0adcb4-8fb5-4b70-92c4-686b1ccef0df service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:26.991604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0adcb4-8fb5-4b70-92c4-686b1ccef0df service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:26.991963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0adcb4-8fb5-4b70-92c4-686b1ccef0df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:27.000434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0adcb4-8fb5-4b70-92c4-686b1ccef0df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:27.002136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0adcb4-8fb5-4b70-92c4-686b1ccef0df service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:27.014596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 698/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:36.910741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:05:37.211466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=78 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:05:47.962245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f645-c348-4972-9070-f498d488285f None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:47.962831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f645-c348-4972-9070-f498d488285f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:47.962831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382f645-c348-4972-9070-f498d488285f None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:47.964088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 712/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 26 20:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:47.969890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fae03-2181-4804-b342-562e57cdaa17 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:47.970320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fae03-2181-4804-b342-562e57cdaa17 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:47.970453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fae03-2181-4804-b342-562e57cdaa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:47.988141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ad2fae03-2181-4804-b342-562e57cdaa17 None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:47.989327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ad2fae03-2181-4804-b342-562e57cdaa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:47.997783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 699/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 26 20:05:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:48.011547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec4f1-caba-4910-8e2f-82e42ab6950d None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:48.011833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec4f1-caba-4910-8e2f-82e42ab6950d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:48.012106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dec4f1-caba-4910-8e2f-82e42ab6950d None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:48.013950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 713/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu May 26 20:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:48.018364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891a939-e27f-4afc-b156-f7856bc11ce0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:48.018650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891a939-e27f-4afc-b156-f7856bc11ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:48.018979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891a939-e27f-4afc-b156-f7856bc11ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:48.036711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9891a939-e27f-4afc-b156-f7856bc11ce0 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:48.037866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9891a939-e27f-4afc-b156-f7856bc11ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:48.046676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 700/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu May 26 20:05:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:05:50.719780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70731-0034-4871-b087-3f0de96231a3 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:50.720301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70731-0034-4871-b087-3f0de96231a3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:50.720423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a70731-0034-4871-b087-3f0de96231a3 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:50.721700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:50.726915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874974b4-d894-41b0-b6b1-7af4068621f8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:50.727318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874974b4-d894-41b0-b6b1-7af4068621f8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:50.727504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874974b4-d894-41b0-b6b1-7af4068621f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:50.745360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-874974b4-d894-41b0-b6b1-7af4068621f8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:50.746571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-874974b4-d894-41b0-b6b1-7af4068621f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:50.754768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:50.797231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70731-0034-4871-b087-3f0de96231a3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:50.812762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a70731-0034-4871-b087-3f0de96231a3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:50.818326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd38bd-a82a-48dd-ab22-28981cc0f331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:50.818995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd38bd-a82a-48dd-ab22-28981cc0f331 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:50.819280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd38bd-a82a-48dd-ab22-28981cc0f331 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:50.819556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd38bd-a82a-48dd-ab22-28981cc0f331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:50.827521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd38bd-a82a-48dd-ab22-28981cc0f331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:50.829089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd38bd-a82a-48dd-ab22-28981cc0f331 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:50.838749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 715/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:51.819468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065338-bf6a-40d7-b8cd-59d1420de863 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:51.820080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065338-bf6a-40d7-b8cd-59d1420de863 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:51.820080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92065338-bf6a-40d7-b8cd-59d1420de863 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:51.821422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:51.826943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ceb3e-f157-4bbf-af1f-6865129b2f00 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:51.827393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ceb3e-f157-4bbf-af1f-6865129b2f00 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:51.827513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ceb3e-f157-4bbf-af1f-6865129b2f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:51.844946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e88ceb3e-f157-4bbf-af1f-6865129b2f00 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:51.846127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e88ceb3e-f157-4bbf-af1f-6865129b2f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:51.854120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:52.042304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065338-bf6a-40d7-b8cd-59d1420de863 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:52.057049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92065338-bf6a-40d7-b8cd-59d1420de863 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:52.063107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7681-85ef-41fb-84de-5a3a18935a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:52.063752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7681-85ef-41fb-84de-5a3a18935a8f service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:52.064499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7681-85ef-41fb-84de-5a3a18935a8f service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:52.064798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7681-85ef-41fb-84de-5a3a18935a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:52.074555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7681-85ef-41fb-84de-5a3a18935a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:52.076819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7681-85ef-41fb-84de-5a3a18935a8f service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:52.087079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 703/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:53.002725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504a09-198f-4c9c-9e0e-82f4913743a5 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:53.003287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504a09-198f-4c9c-9e0e-82f4913743a5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:53.003287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61504a09-198f-4c9c-9e0e-82f4913743a5 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:53.004573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:53.009599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235805-12ba-44cb-acd5-90781f163343 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:53.010004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235805-12ba-44cb-acd5-90781f163343 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:53.010194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5235805-12ba-44cb-acd5-90781f163343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:53.028988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e5235805-12ba-44cb-acd5-90781f163343 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:53.030175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e5235805-12ba-44cb-acd5-90781f163343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:53.037836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:53.187410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61504a09-198f-4c9c-9e0e-82f4913743a5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:53.202542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61504a09-198f-4c9c-9e0e-82f4913743a5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:53.207863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bf458-126d-44cd-befe-7c8cb6edc8ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:53.208493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf458-126d-44cd-befe-7c8cb6edc8ce service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:53.208775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf458-126d-44cd-befe-7c8cb6edc8ce service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:53.209048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bf458-126d-44cd-befe-7c8cb6edc8ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:53.217522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bf458-126d-44cd-befe-7c8cb6edc8ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:53.219119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2bf458-126d-44cd-befe-7c8cb6edc8ce service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:53.228219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 718/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:54.136423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8ad1-b9d5-4eea-8c2d-07f41b212f77 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:54.136975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8ad1-b9d5-4eea-8c2d-07f41b212f77 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:54.136975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e8ad1-b9d5-4eea-8c2d-07f41b212f77 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:54.139012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:54.144000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d7a61-4f7d-4b45-b847-66569581e890 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:54.144436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d7a61-4f7d-4b45-b847-66569581e890 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:54.144557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d7a61-4f7d-4b45-b847-66569581e890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:54.162048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e42d7a61-4f7d-4b45-b847-66569581e890 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:54.163265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e42d7a61-4f7d-4b45-b847-66569581e890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:54.170993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:54.319084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e8ad1-b9d5-4eea-8c2d-07f41b212f77 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:54.334043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e8ad1-b9d5-4eea-8c2d-07f41b212f77 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:54.339418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3435852-f0fe-4d3c-9226-58d6ece350b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:54.340059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435852-f0fe-4d3c-9226-58d6ece350b0 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:54.340342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435852-f0fe-4d3c-9226-58d6ece350b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:54.340621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3435852-f0fe-4d3c-9226-58d6ece350b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:54.348620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3435852-f0fe-4d3c-9226-58d6ece350b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:54.350189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3435852-f0fe-4d3c-9226-58d6ece350b0 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:54.359514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 706/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:55.273260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49937ed5-b46f-4f7e-8ab1-a314e17e7577 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:55.273800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49937ed5-b46f-4f7e-8ab1-a314e17e7577 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:55.273800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49937ed5-b46f-4f7e-8ab1-a314e17e7577 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:55.275224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:55.280595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdf022-2a7e-4f9a-99c7-1eaa53461c35 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:55.281041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdf022-2a7e-4f9a-99c7-1eaa53461c35 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:55.281153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fdf022-2a7e-4f9a-99c7-1eaa53461c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:55.298955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-57fdf022-2a7e-4f9a-99c7-1eaa53461c35 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:55.300147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-57fdf022-2a7e-4f9a-99c7-1eaa53461c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:55.307856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:55.459464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49937ed5-b46f-4f7e-8ab1-a314e17e7577 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:55.473869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49937ed5-b46f-4f7e-8ab1-a314e17e7577 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:55.479093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ecc23-b6e0-499e-ad91-a48e871cd4d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:55.479720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecc23-b6e0-499e-ad91-a48e871cd4d8 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:55.479999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecc23-b6e0-499e-ad91-a48e871cd4d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:55.480275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ecc23-b6e0-499e-ad91-a48e871cd4d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:55.488094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ecc23-b6e0-499e-ad91-a48e871cd4d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:55.489663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ecc23-b6e0-499e-ad91-a48e871cd4d8 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:55.498779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 721/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:56.345939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7bf88-5eb2-4d56-be4e-3d16880fe872 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:56.346509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7bf88-5eb2-4d56-be4e-3d16880fe872 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:56.346649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7bf88-5eb2-4d56-be4e-3d16880fe872 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:56.348075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:56.353025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0cfb4-d7be-4931-9bce-7d7db6f6659c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:56.353459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0cfb4-d7be-4931-9bce-7d7db6f6659c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:56.353594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a0cfb4-d7be-4931-9bce-7d7db6f6659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:56.372089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-12a0cfb4-d7be-4931-9bce-7d7db6f6659c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:56.373288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-12a0cfb4-d7be-4931-9bce-7d7db6f6659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:56.381182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:56.532438 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7bf88-5eb2-4d56-be4e-3d16880fe872 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:56.546577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7bf88-5eb2-4d56-be4e-3d16880fe872 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:56.551923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884b0c-da02-440e-bad1-d219ea8b596c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:56.552554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b0c-da02-440e-bad1-d219ea8b596c service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:56.552837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b0c-da02-440e-bad1-d219ea8b596c service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:56.553113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b0c-da02-440e-bad1-d219ea8b596c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:56.561477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884b0c-da02-440e-bad1-d219ea8b596c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:56.563081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a884b0c-da02-440e-bad1-d219ea8b596c service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:56.572462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 709/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:57.421955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba882a-5ede-4880-b984-90f2b4409ae8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:57.422521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba882a-5ede-4880-b984-90f2b4409ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:57.422521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba882a-5ede-4880-b984-90f2b4409ae8 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:57.424854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:57.429760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393f3d6-fe00-4b69-b341-8464e802cf29 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:57.430205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393f3d6-fe00-4b69-b341-8464e802cf29 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:57.430301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393f3d6-fe00-4b69-b341-8464e802cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:57.449009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6393f3d6-fe00-4b69-b341-8464e802cf29 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:57.450188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6393f3d6-fe00-4b69-b341-8464e802cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:57.457835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:05:57.604983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba882a-5ede-4880-b984-90f2b4409ae8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:57.619536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba882a-5ede-4880-b984-90f2b4409ae8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:57.625502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e90361-c56d-475a-87e5-2b0ee2516470 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:57.626143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90361-c56d-475a-87e5-2b0ee2516470 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:57.626427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90361-c56d-475a-87e5-2b0ee2516470 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:57.626707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90361-c56d-475a-87e5-2b0ee2516470 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:57.635183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e90361-c56d-475a-87e5-2b0ee2516470 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:57.636765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e90361-c56d-475a-87e5-2b0ee2516470 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:57.646266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 724/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:58.480136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69b80-e5c8-43af-8d98-5430825ecd8a None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:58.480705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69b80-e5c8-43af-8d98-5430825ecd8a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:58.480705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda69b80-e5c8-43af-8d98-5430825ecd8a None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:58.482100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:58.486866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d244e0-8b35-401c-88b6-eba1ae4ecd15 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:58.487272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d244e0-8b35-401c-88b6-eba1ae4ecd15 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:58.487431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d244e0-8b35-401c-88b6-eba1ae4ecd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:58.505203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b6d244e0-8b35-401c-88b6-eba1ae4ecd15 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:58.506382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b6d244e0-8b35-401c-88b6-eba1ae4ecd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:58.514500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:58.664771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69b80-e5c8-43af-8d98-5430825ecd8a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:58.679222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda69b80-e5c8-43af-8d98-5430825ecd8a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:58.685071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be426072-89f4-4659-8f16-7eff90492644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:58.685707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426072-89f4-4659-8f16-7eff90492644 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:58.685994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426072-89f4-4659-8f16-7eff90492644 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:58.686273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be426072-89f4-4659-8f16-7eff90492644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:58.694487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be426072-89f4-4659-8f16-7eff90492644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:58.696094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be426072-89f4-4659-8f16-7eff90492644 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:58.705870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 712/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:05:59.552429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c03c7e-2350-4619-b74a-82d6aa559a13 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:59.552968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c03c7e-2350-4619-b74a-82d6aa559a13 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:59.553086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c03c7e-2350-4619-b74a-82d6aa559a13 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:59.554375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:05:59.559442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196bef-dda4-42e2-9600-65874db75790 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:59.559872 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196bef-dda4-42e2-9600-65874db75790 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:59.559988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee196bef-dda4-42e2-9600-65874db75790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:59.578156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ee196bef-dda4-42e2-9600-65874db75790 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:05:59.579385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ee196bef-dda4-42e2-9600-65874db75790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:05:59.586979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:05:59.737594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c03c7e-2350-4619-b74a-82d6aa559a13 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:05:59.751557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c03c7e-2350-4619-b74a-82d6aa559a13 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:05:59.756757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105d3bb-5b1c-4e56-9705-b0b10176ffe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:05:59.757385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d3bb-5b1c-4e56-9705-b0b10176ffe7 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:05:59.757666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d3bb-5b1c-4e56-9705-b0b10176ffe7 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:05:59.757937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105d3bb-5b1c-4e56-9705-b0b10176ffe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:05:59.766251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d3bb-5b1c-4e56-9705-b0b10176ffe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:05:59.767841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105d3bb-5b1c-4e56-9705-b0b10176ffe7 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:05:59.776911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 727/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:01.855806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e994-8e09-4dce-b350-cee85fc430b3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:01.856926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e994-8e09-4dce-b350-cee85fc430b3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:01.857241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e994-8e09-4dce-b350-cee85fc430b3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:01.859486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:06:01.866084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180641c8-7c65-4bf1-adf4-d5a27bd6f989 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:01.866503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180641c8-7c65-4bf1-adf4-d5a27bd6f989 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:01.867512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180641c8-7c65-4bf1-adf4-d5a27bd6f989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:01.886464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-180641c8-7c65-4bf1-adf4-d5a27bd6f989 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:01.887651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-180641c8-7c65-4bf1-adf4-d5a27bd6f989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:01.895443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:01.933922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55e994-8e09-4dce-b350-cee85fc430b3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:01.944801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55e994-8e09-4dce-b350-cee85fc430b3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:01.948274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28299e1-2800-460d-ad8d-5dc2f69f9661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:01.948908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28299e1-2800-460d-ad8d-5dc2f69f9661 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:01.949188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28299e1-2800-460d-ad8d-5dc2f69f9661 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:01.949464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28299e1-2800-460d-ad8d-5dc2f69f9661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:01.958686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28299e1-2800-460d-ad8d-5dc2f69f9661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:01.960126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28299e1-2800-460d-ad8d-5dc2f69f9661 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:01.970248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 715/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:04.414816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def980d3-f94b-4421-aab9-a2b94e808925 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:04.415355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def980d3-f94b-4421-aab9-a2b94e808925 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:04.415453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def980d3-f94b-4421-aab9-a2b94e808925 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:04.416930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:04.422026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6217a-67d0-4abf-b99b-a6823654754e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:04.422420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6217a-67d0-4abf-b99b-a6823654754e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:04.422585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6217a-67d0-4abf-b99b-a6823654754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:04.440294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1db6217a-67d0-4abf-b99b-a6823654754e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:04.441456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1db6217a-67d0-4abf-b99b-a6823654754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:04.449032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:04.486414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def980d3-f94b-4421-aab9-a2b94e808925 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:04.497065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def980d3-f94b-4421-aab9-a2b94e808925 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:04.500661 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590a2d4-bca3-46c1-8c8f-9b72d3618ec6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:04.501301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590a2d4-bca3-46c1-8c8f-9b72d3618ec6 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:04.501587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590a2d4-bca3-46c1-8c8f-9b72d3618ec6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:04.501866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590a2d4-bca3-46c1-8c8f-9b72d3618ec6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:04.510635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590a2d4-bca3-46c1-8c8f-9b72d3618ec6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:04.512097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590a2d4-bca3-46c1-8c8f-9b72d3618ec6 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:04.521810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 730/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:06:07.024145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5b67-3606-4240-be09-3c0f75da0ef8 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:07.024693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5b67-3606-4240-be09-3c0f75da0ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:07.024693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d5b67-3606-4240-be09-3c0f75da0ef8 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:07.025984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:07.031851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264b001-ab2f-4d2f-a9ca-083e74be1de3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:07.032276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264b001-ab2f-4d2f-a9ca-083e74be1de3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:07.032403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264b001-ab2f-4d2f-a9ca-083e74be1de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:07.050722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7264b001-ab2f-4d2f-a9ca-083e74be1de3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:07.051943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7264b001-ab2f-4d2f-a9ca-083e74be1de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:07.060589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:07.098965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5b67-3606-4240-be09-3c0f75da0ef8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:07.110158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d5b67-3606-4240-be09-3c0f75da0ef8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:07.113627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b6574-58a1-4505-85dd-2c0f54454965 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:07.114259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b6574-58a1-4505-85dd-2c0f54454965 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:07.114544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b6574-58a1-4505-85dd-2c0f54454965 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:07.114824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b6574-58a1-4505-85dd-2c0f54454965 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:07.123588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b6574-58a1-4505-85dd-2c0f54454965 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:07.125006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951b6574-58a1-4505-85dd-2c0f54454965 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:07.134234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 718/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:09.457411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed45ce-df61-4e63-9aa6-4c46352206a3 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:09.458010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed45ce-df61-4e63-9aa6-4c46352206a3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:09.458010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed45ce-df61-4e63-9aa6-4c46352206a3 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:09.459456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:09.464697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae83f-70c7-49f4-98b0-78c50defbd85 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:09.465149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae83f-70c7-49f4-98b0-78c50defbd85 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:09.465259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ae83f-70c7-49f4-98b0-78c50defbd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:09.484101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a68ae83f-70c7-49f4-98b0-78c50defbd85 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:09.485285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a68ae83f-70c7-49f4-98b0-78c50defbd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:09.493040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:06:09.530941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed45ce-df61-4e63-9aa6-4c46352206a3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:09.541331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed45ce-df61-4e63-9aa6-4c46352206a3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:09.545255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36ab47-353c-4044-95b2-7bd3b801cf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:09.545877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ab47-353c-4044-95b2-7bd3b801cf4b service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:09.546152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ab47-353c-4044-95b2-7bd3b801cf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:09.546420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36ab47-353c-4044-95b2-7bd3b801cf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:09.554958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ab47-353c-4044-95b2-7bd3b801cf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:09.556369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36ab47-353c-4044-95b2-7bd3b801cf4b service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:09.566759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 733/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:11.832147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296f2ba-4357-418d-aafa-b9f04eadca11 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:11.832729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296f2ba-4357-418d-aafa-b9f04eadca11 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:11.832729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296f2ba-4357-418d-aafa-b9f04eadca11 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:11.834125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:11.839409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a54f-7ed3-4893-a97b-fcb962b3f4d8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:11.839848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a54f-7ed3-4893-a97b-fcb962b3f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:11.839955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f847a54f-7ed3-4893-a97b-fcb962b3f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:11.857877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f847a54f-7ed3-4893-a97b-fcb962b3f4d8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:11.859096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f847a54f-7ed3-4893-a97b-fcb962b3f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:11.866709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:11.904492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296f2ba-4357-418d-aafa-b9f04eadca11 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:11.914988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296f2ba-4357-418d-aafa-b9f04eadca11 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:11.918455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac38a54-e4c3-4c18-804b-3487398c9050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:11.919129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38a54-e4c3-4c18-804b-3487398c9050 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:11.919412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38a54-e4c3-4c18-804b-3487398c9050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:11.920195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac38a54-e4c3-4c18-804b-3487398c9050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:11.928951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac38a54-e4c3-4c18-804b-3487398c9050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:11.930430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac38a54-e4c3-4c18-804b-3487398c9050 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:11.940695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 721/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:14.198439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f33a52-5195-423f-8ec0-e4e894672f1a None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:14.199005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f33a52-5195-423f-8ec0-e4e894672f1a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:14.199109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f33a52-5195-423f-8ec0-e4e894672f1a None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:14.200409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:14.205654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9d3d-c645-4a09-a5f9-b7bdd1eb7e47 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:14.206031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9d3d-c645-4a09-a5f9-b7bdd1eb7e47 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:14.206230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d9d3d-c645-4a09-a5f9-b7bdd1eb7e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:14.224172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-065d9d3d-c645-4a09-a5f9-b7bdd1eb7e47 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:14.225368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-065d9d3d-c645-4a09-a5f9-b7bdd1eb7e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:14.233733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:14.271067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f33a52-5195-423f-8ec0-e4e894672f1a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:14.282107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f33a52-5195-423f-8ec0-e4e894672f1a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:14.285631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09191ec6-5d55-4cb5-9abe-370497fd51f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:14.286258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09191ec6-5d55-4cb5-9abe-370497fd51f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:14.286540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09191ec6-5d55-4cb5-9abe-370497fd51f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:14.286815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09191ec6-5d55-4cb5-9abe-370497fd51f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:14.296143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09191ec6-5d55-4cb5-9abe-370497fd51f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:14.297579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09191ec6-5d55-4cb5-9abe-370497fd51f6 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:14.307072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 736/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:16.560405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8eec-c209-4e57-be0b-81f5b612d581 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:16.560988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8eec-c209-4e57-be0b-81f5b612d581 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:16.560988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b8eec-c209-4e57-be0b-81f5b612d581 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:16.562345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:16.568008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2800ef-c090-455b-94a8-08404b0fbc07 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:16.568408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2800ef-c090-455b-94a8-08404b0fbc07 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:16.568593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2800ef-c090-455b-94a8-08404b0fbc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:16.586098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ed2800ef-c090-455b-94a8-08404b0fbc07 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:16.587328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ed2800ef-c090-455b-94a8-08404b0fbc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:16.595700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:16.632230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8eec-c209-4e57-be0b-81f5b612d581 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:16.643015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b8eec-c209-4e57-be0b-81f5b612d581 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:16.646500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5a846-bfee-461a-a4f1-6dcf69521f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:16.647165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a846-bfee-461a-a4f1-6dcf69521f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:16.647464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a846-bfee-461a-a4f1-6dcf69521f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:16.647743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a846-bfee-461a-a4f1-6dcf69521f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:16.657009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5a846-bfee-461a-a4f1-6dcf69521f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:16.658441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5a846-bfee-461a-a4f1-6dcf69521f69 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:16.667627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 724/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:18.952917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71425c-e535-43f9-8294-984a5e2f3545 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:18.953506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71425c-e535-43f9-8294-984a5e2f3545 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:18.953506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71425c-e535-43f9-8294-984a5e2f3545 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:18.954858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:18.960161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b76f4-b227-4307-8582-73ae0218b306 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:18.960571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b76f4-b227-4307-8582-73ae0218b306 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:18.960732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b76f4-b227-4307-8582-73ae0218b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:18.967379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=79 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:06:18.979597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8a4b76f4-b227-4307-8582-73ae0218b306 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:18.980788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8a4b76f4-b227-4307-8582-73ae0218b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:18.992735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:19.028760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71425c-e535-43f9-8294-984a5e2f3545 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:19.034552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=73 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:06:19.040570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71425c-e535-43f9-8294-984a5e2f3545 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:19.044010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c8940-3762-4c94-af78-dd1e823743e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:19.045259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8940-3762-4c94-af78-dd1e823743e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:19.045539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8940-3762-4c94-af78-dd1e823743e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:19.045806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c8940-3762-4c94-af78-dd1e823743e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:19.054480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8940-3762-4c94-af78-dd1e823743e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:19.055924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c8940-3762-4c94-af78-dd1e823743e3 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:19.065257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 739/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:21.280596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb59a8-3b23-4b2c-8a0a-4278d507fd1d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:21.281161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb59a8-3b23-4b2c-8a0a-4278d507fd1d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:21.281161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb59a8-3b23-4b2c-8a0a-4278d507fd1d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:21.282532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:21.287805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45c0a-7d10-4f34-9d59-7f3c92fbc857 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:21.288248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45c0a-7d10-4f34-9d59-7f3c92fbc857 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:21.288356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f45c0a-7d10-4f34-9d59-7f3c92fbc857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:21.306258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-66f45c0a-7d10-4f34-9d59-7f3c92fbc857 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:21.307462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-66f45c0a-7d10-4f34-9d59-7f3c92fbc857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:21.315325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:21.351089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb59a8-3b23-4b2c-8a0a-4278d507fd1d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:21.352753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1dfb59a8-3b23-4b2c-8a0a-4278d507fd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:21.366776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb59a8-3b23-4b2c-8a0a-4278d507fd1d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:21.371503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bcca2-042e-43db-975e-5ba678b91f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:21.372166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bcca2-042e-43db-975e-5ba678b91f0a service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:21.372451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bcca2-042e-43db-975e-5ba678b91f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:21.372750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bcca2-042e-43db-975e-5ba678b91f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:21.381697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bcca2-042e-43db-975e-5ba678b91f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:21.383149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bcca2-042e-43db-975e-5ba678b91f0a service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:21.392964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 727/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:06:23.596707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a746a-0949-4032-93a0-e3b3aa75b858 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:23.597271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a746a-0949-4032-93a0-e3b3aa75b858 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:23.597271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a746a-0949-4032-93a0-e3b3aa75b858 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:23.598599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:23.604189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e078b5-4e9a-455a-a044-ff8a04ceb4fd None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:23.604567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e078b5-4e9a-455a-a044-ff8a04ceb4fd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:23.604750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e078b5-4e9a-455a-a044-ff8a04ceb4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:23.622158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c6e078b5-4e9a-455a-a044-ff8a04ceb4fd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:23.624223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c6e078b5-4e9a-455a-a044-ff8a04ceb4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:23.633951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:23.670279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a746a-0949-4032-93a0-e3b3aa75b858 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:23.680795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a746a-0949-4032-93a0-e3b3aa75b858 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:23.684237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f78a6-b4e3-46bc-9e85-b54d9453cca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:23.684863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f78a6-b4e3-46bc-9e85-b54d9453cca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:23.685755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f78a6-b4e3-46bc-9e85-b54d9453cca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:23.686027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f78a6-b4e3-46bc-9e85-b54d9453cca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:23.694802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f78a6-b4e3-46bc-9e85-b54d9453cca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:23.696237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f78a6-b4e3-46bc-9e85-b54d9453cca0 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:23.705763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 742/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:06:33.617073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=11 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:06:33.701344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=14 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:06:56.746574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d03c-9413-4df6-b9a5-5793242c21f9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:56.747174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d03c-9413-4df6-b9a5-5793242c21f9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:56.747174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d03c-9413-4df6-b9a5-5793242c21f9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:56.748486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 729/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:56.753834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458ff7-6f44-4c60-947c-9708130cb7c8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:56.754288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458ff7-6f44-4c60-947c-9708130cb7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:56.754424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24458ff7-6f44-4c60-947c-9708130cb7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:56.771625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-24458ff7-6f44-4c60-947c-9708130cb7c8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:56.772791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-24458ff7-6f44-4c60-947c-9708130cb7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:56.780921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 743/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:56.827223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22825-994b-4caa-8260-62c81b9d860b None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:56.827552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22825-994b-4caa-8260-62c81b9d860b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:56.827839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d22825-994b-4caa-8260-62c81b9d860b None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:56.829202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 730/1473] 10.222.0.48 () {54 vars in 962 bytes} [Thu May 26 20:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:56.834119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720139c9-6ba0-41cf-ab2f-3953bea56935 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:56.834412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720139c9-6ba0-41cf-ab2f-3953bea56935 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:56.834693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720139c9-6ba0-41cf-ab2f-3953bea56935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:56.852508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-720139c9-6ba0-41cf-ab2f-3953bea56935 None None] MFA Rules not processed for user `8376ffaa09e2496a80fa60c979769d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:56.853668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-720139c9-6ba0-41cf-ab2f-3953bea56935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:56.860460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 744/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Thu May 26 20:06:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:56.867240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d22825-994b-4caa-8260-62c81b9d860b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:56.877598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d22825-994b-4caa-8260-62c81b9d860b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:56.881199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dddfb-1c11-4c38-84cc-a0da66c12baa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8376ffaa09e2496a80fa60c979769d8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:56.881827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dddfb-1c11-4c38-84cc-a0da66c12baa service glance] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:56.882112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dddfb-1c11-4c38-84cc-a0da66c12baa service glance] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:56.882387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dddfb-1c11-4c38-84cc-a0da66c12baa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:56.891239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dddfb-1c11-4c38-84cc-a0da66c12baa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:56.892655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dddfb-1c11-4c38-84cc-a0da66c12baa service glance] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:56.901916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 731/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:06:59.203314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9bba-65ee-4b93-8b77-67405dfb2f25 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:59.203914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9bba-65ee-4b93-8b77-67405dfb2f25 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:59.203914 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9bba-65ee-4b93-8b77-67405dfb2f25 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:59.205235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 745/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:06:59.210407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025951-3b70-47e9-a4ac-9fb6a295ef17 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:59.210806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025951-3b70-47e9-a4ac-9fb6a295ef17 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:59.210991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67025951-3b70-47e9-a4ac-9fb6a295ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:59.228245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-67025951-3b70-47e9-a4ac-9fb6a295ef17 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:06:59.229424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-67025951-3b70-47e9-a4ac-9fb6a295ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:06:59.237056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 732/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:06:59.261731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9bba-65ee-4b93-8b77-67405dfb2f25 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:06:59.274767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9bba-65ee-4b93-8b77-67405dfb2f25 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:06:59.279136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5036e2-b63b-4713-9514-37b602ebfd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:06:59.279781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5036e2-b63b-4713-9514-37b602ebfd7d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:06:59.280061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5036e2-b63b-4713-9514-37b602ebfd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:06:59.280334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5036e2-b63b-4713-9514-37b602ebfd7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:06:59.281052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5036e2-b63b-4713-9514-37b602ebfd7d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:06:59.282795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-bb5036e2-b63b-4713-9514-37b602ebfd7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:06:59.282795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:06:59.282795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:06:59.283954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5036e2-b63b-4713-9514-37b602ebfd7d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:06:59.303791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 746/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu May 26 20:06:59 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:07:01.525172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a41f8e-c7e4-49f0-8bdd-d1a936374cf2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:01.525707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a41f8e-c7e4-49f0-8bdd-d1a936374cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:01.525707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a41f8e-c7e4-49f0-8bdd-d1a936374cf2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:01.527050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 733/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:07:01.532886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f744-6b8c-4e5e-a6ea-ac89b04249d4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:01.533314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f744-6b8c-4e5e-a6ea-ac89b04249d4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:01.533443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d635f744-6b8c-4e5e-a6ea-ac89b04249d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:01.551474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d635f744-6b8c-4e5e-a6ea-ac89b04249d4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:07:01.552659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d635f744-6b8c-4e5e-a6ea-ac89b04249d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:07:01.560376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 747/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:07:01.603605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a41f8e-c7e4-49f0-8bdd-d1a936374cf2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:07:01.617808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a41f8e-c7e4-49f0-8bdd-d1a936374cf2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:07:01.623316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2682301e-39fa-443d-92e1-ce5864dcc8d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:07:01.623958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682301e-39fa-443d-92e1-ce5864dcc8d5 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:01.624251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682301e-39fa-443d-92e1-ce5864dcc8d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:01.624531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2682301e-39fa-443d-92e1-ce5864dcc8d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:01.632953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682301e-39fa-443d-92e1-ce5864dcc8d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:07:01.634519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2682301e-39fa-443d-92e1-ce5864dcc8d5 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:07:01.647706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 734/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:07:04.034244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5208-cb06-487a-b617-cd17481c3456 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:04.034814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5208-cb06-487a-b617-cd17481c3456 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:04.034814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a5208-cb06-487a-b617-cd17481c3456 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:04.036133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 748/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:07:04.041531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a3bc9-44cc-49e2-b14c-63c8e222757e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:04.041947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a3bc9-44cc-49e2-b14c-63c8e222757e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:04.042088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a3bc9-44cc-49e2-b14c-63c8e222757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:04.065833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-465a3bc9-44cc-49e2-b14c-63c8e222757e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:07:04.067096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-465a3bc9-44cc-49e2-b14c-63c8e222757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:07:04.074893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 735/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:07:04.110518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5208-cb06-487a-b617-cd17481c3456 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:07:04.121080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02a5208-cb06-487a-b617-cd17481c3456 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:07:04.125180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e1333-c2a6-45e2-8dbb-e3715f761782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:07:04.125813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e1333-c2a6-45e2-8dbb-e3715f761782 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:04.126094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e1333-c2a6-45e2-8dbb-e3715f761782 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:04.126368 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e1333-c2a6-45e2-8dbb-e3715f761782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:04.135053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e1333-c2a6-45e2-8dbb-e3715f761782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:07:04.136484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e1333-c2a6-45e2-8dbb-e3715f761782 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:07:04.145698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 749/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:07:06.403763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb25a4-54bc-48da-999f-9d316f7d6bdb None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:06.404374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb25a4-54bc-48da-999f-9d316f7d6bdb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:06.404374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb25a4-54bc-48da-999f-9d316f7d6bdb None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:06.405703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 736/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:07:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:07:06.410880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53233b-135d-43e1-a38c-f5c730fed664 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:06.411279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53233b-135d-43e1-a38c-f5c730fed664 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:06.411437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53233b-135d-43e1-a38c-f5c730fed664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:06.429046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fc53233b-135d-43e1-a38c-f5c730fed664 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:07:06.430216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fc53233b-135d-43e1-a38c-f5c730fed664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:07:06.438663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 750/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:07:06.475909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb25a4-54bc-48da-999f-9d316f7d6bdb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:07:06.486398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb25a4-54bc-48da-999f-9d316f7d6bdb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:07:06.489889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9c6b0-e714-48c4-bf72-eb368efb0e8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:07:06.490518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c6b0-e714-48c4-bf72-eb368efb0e8b service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:06.490801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c6b0-e714-48c4-bf72-eb368efb0e8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:06.491106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9c6b0-e714-48c4-bf72-eb368efb0e8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:06.500343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c6b0-e714-48c4-bf72-eb368efb0e8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:07:06.501761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9c6b0-e714-48c4-bf72-eb368efb0e8b service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:07:06.510928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 737/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:07:08.859160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41df4ee-a180-4a6d-a8f7-929b4857d11e None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:08.859717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41df4ee-a180-4a6d-a8f7-929b4857d11e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:08.859717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41df4ee-a180-4a6d-a8f7-929b4857d11e None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:08.861080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 751/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:07:08.866201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41c16-424c-4550-89ba-c62e9326d5ea None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:08.866628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41c16-424c-4550-89ba-c62e9326d5ea None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:08.866775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41c16-424c-4550-89ba-c62e9326d5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:08.885224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-43b41c16-424c-4550-89ba-c62e9326d5ea None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:07:08.886507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-43b41c16-424c-4550-89ba-c62e9326d5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:07:08.895514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 738/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:07:08.936052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41df4ee-a180-4a6d-a8f7-929b4857d11e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:07:08.946971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41df4ee-a180-4a6d-a8f7-929b4857d11e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:07:08.951080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636dd0a-adb2-44b8-86a4-fbb83822c327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:07:08.951716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636dd0a-adb2-44b8-86a4-fbb83822c327 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:08.951995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636dd0a-adb2-44b8-86a4-fbb83822c327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:08.952277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636dd0a-adb2-44b8-86a4-fbb83822c327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:08.961014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636dd0a-adb2-44b8-86a4-fbb83822c327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:07:08.962426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e636dd0a-adb2-44b8-86a4-fbb83822c327 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:07:08.971797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 752/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:07:11.372364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6b79e-1201-43a3-8b0f-88d48048628d None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:11.373143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6b79e-1201-43a3-8b0f-88d48048628d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:11.373143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6b79e-1201-43a3-8b0f-88d48048628d None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:11.374234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 739/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu May 26 20:07:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:07:11.379452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54db820-8899-4c37-afe5-72ee82e66c6c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:11.379884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54db820-8899-4c37-afe5-72ee82e66c6c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:11.380009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54db820-8899-4c37-afe5-72ee82e66c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:11.397216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a54db820-8899-4c37-afe5-72ee82e66c6c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:07:11.398401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a54db820-8899-4c37-afe5-72ee82e66c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:07:11.406111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 753/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu May 26 20:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:07:11.445237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6b79e-1201-43a3-8b0f-88d48048628d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:07:11.455812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6b79e-1201-43a3-8b0f-88d48048628d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:07:11.459325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b779f-99f1-4033-a631-7b877ed382b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:07:11.459962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b779f-99f1-4033-a631-7b877ed382b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:07:11.460246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b779f-99f1-4033-a631-7b877ed382b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:07:11.460523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b779f-99f1-4033-a631-7b877ed382b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:07:11.469270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b779f-99f1-4033-a631-7b877ed382b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:07:11.470701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b779f-99f1-4033-a631-7b877ed382b5 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:07:11.480154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 740/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:07:21.392247 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=33 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:07:21.475919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=33 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:09:01.157456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d790b-225f-4ff2-abe5-ee101b8eef0a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.160615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d790b-225f-4ff2-abe5-ee101b8eef0a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.160615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d790b-225f-4ff2-abe5-ee101b8eef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.176619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e42d790b-225f-4ff2-abe5-ee101b8eef0a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:09:01.177839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e42d790b-225f-4ff2-abe5-ee101b8eef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:09:01.187123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 754/1494] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:09:01.196416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b34c-3510-4d01-8a2d-e1a032c70227 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.197492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b34c-3510-4d01-8a2d-e1a032c70227 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.197600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440b34c-3510-4d01-8a2d-e1a032c70227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.215623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1440b34c-3510-4d01-8a2d-e1a032c70227 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:09:01.216874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1440b34c-3510-4d01-8a2d-e1a032c70227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:09:01.224813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 741/1495] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:09:01.229177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d790b-225f-4ff2-abe5-ee101b8eef0a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.238593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d790b-225f-4ff2-abe5-ee101b8eef0a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.242986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.244202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.244489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.244770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.245475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:09:01.245774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.246770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:01.246770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:09:01.246770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:09:01.247674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.258939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 755/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:09:01.267486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440b34c-3510-4d01-8a2d-e1a032c70227 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.276572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440b34c-3510-4d01-8a2d-e1a032c70227 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.281138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.281787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.282073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.282351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.283078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.284832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:01.284832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 26 20:09:01.284832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: May 26 20:09:01.286031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.322485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 742/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:09:01 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:09:01.326658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.336332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f91ea9-8623-49de-b6f1-efd9d74c2390 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.390293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.391009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.391289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.391562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.392238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.393237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:01.393237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:09:01.393237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:09:01.394423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.413783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 756/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:09:01 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:09:01.417832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.427852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bcec4-ab8c-4a01-b16d-7929c9ad8d5a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.432840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.433499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.433785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.434060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.434785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.435824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:01.435824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 26 20:09:01.435824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: May 26 20:09:01.436699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.450289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 743/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:09:01.454386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.464153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97db3c8-f970-4449-95b0-69d946c21191 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.468552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c263cf-24b9-4282-b155-8cd040065b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.469252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c263cf-24b9-4282-b155-8cd040065b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.469539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c263cf-24b9-4282-b155-8cd040065b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.469813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c263cf-24b9-4282-b155-8cd040065b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.470527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c263cf-24b9-4282-b155-8cd040065b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.471570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-d9c263cf-24b9-4282-b155-8cd040065b48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:01.471570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:09:01.471570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:09:01.472457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c263cf-24b9-4282-b155-8cd040065b48 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.485860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 757/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:09:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:09:01.489852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.500262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6caa6-02a7-44fc-9a66-e5ebc095c70c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.505030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cca464-3521-4be5-9188-68a0b61a0bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.505936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca464-3521-4be5-9188-68a0b61a0bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.506222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca464-3521-4be5-9188-68a0b61a0bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.506497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cca464-3521-4be5-9188-68a0b61a0bfe admin admin] PATH_INFO: `/v3/projects/137987f88ec44d1db8ff17e3fd745c0e/users/15b542f083d9438c9aa004333310d729/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.521695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cca464-3521-4be5-9188-68a0b61a0bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=137987f88ec44d1db8ff17e3fd745c0e, user_id=15b542f083d9438c9aa004333310d729, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.522717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-07cca464-3521-4be5-9188-68a0b61a0bfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:01.522717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 26 20:09:01.522717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: May 26 20:09:01.524680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cca464-3521-4be5-9188-68a0b61a0bfe admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.537482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 744/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:09:01 2022] PUT /identity/v3/projects/137987f88ec44d1db8ff17e3fd745c0e/users/15b542f083d9438c9aa004333310d729/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:09:01.549043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e58e3-301b-408a-8107-c0e916507613 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.549335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e58e3-301b-408a-8107-c0e916507613 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.549611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e58e3-301b-408a-8107-c0e916507613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.576566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6a5e58e3-301b-408a-8107-c0e916507613 None None] MFA Rules not processed for user `15b542f083d9438c9aa004333310d729`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:09:01.577771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6a5e58e3-301b-408a-8107-c0e916507613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:09:01.641254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 758/1502] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:09:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:09:01.654830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358c61-5e3a-41eb-9d47-d37f0ef0d8e7 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.655155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358c61-5e3a-41eb-9d47-d37f0ef0d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.655434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01358c61-5e3a-41eb-9d47-d37f0ef0d8e7 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.656796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 745/1503] 10.222.0.48 () {54 vars in 963 bytes} [Thu May 26 20:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:09:01.661530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4faf2-66cb-45e9-b20d-aefcdddde241 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.661821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4faf2-66cb-45e9-b20d-aefcdddde241 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.662094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4faf2-66cb-45e9-b20d-aefcdddde241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.679574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-93d4faf2-66cb-45e9-b20d-aefcdddde241 None None] MFA Rules not processed for user `4225e82ea268483daa86078abb11c7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:09:01.680697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-93d4faf2-66cb-45e9-b20d-aefcdddde241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:09:01.726980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:09:01.735363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 759/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Thu May 26 20:09:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:09:01.742896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01358c61-5e3a-41eb-9d47-d37f0ef0d8e7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.753131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01358c61-5e3a-41eb-9d47-d37f0ef0d8e7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.756566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.757190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.757472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.757747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.766507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.767981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.777794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 746/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:09:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:09:01.820705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628c80-335c-40a6-ac73-95aac883b3aa None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.820996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628c80-335c-40a6-ac73-95aac883b3aa None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.821274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36628c80-335c-40a6-ac73-95aac883b3aa None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.823127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 760/1506] 10.222.0.48 () {52 vars in 829 bytes} [Thu May 26 20:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:09:01.826431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:01.888776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5af4f7-aa3c-46af-814b-9662b6d04266 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:01.893284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:01.894158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:01.894445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:01.894725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] PATH_INFO: `/v3/users/15b542f083d9438c9aa004333310d729` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:01.895952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b542f083d9438c9aa004333310d729)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:01.896966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:01.896966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 26 20:09:01.896966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: May 26 20:09:01.898174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:01.963860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b542f083d9438c9aa004333310d729'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:01.964427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b542f083d9438c9aa004333310d729'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:01.965165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b542f083d9438c9aa004333310d729'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:01.977296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b542f083d9438c9aa004333310d729'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:01.995614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b542f083d9438c9aa004333310d729'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:01.999528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:09:02.012420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 747/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:09:01 2022] DELETE /identity/v3/users/15b542f083d9438c9aa004333310d729 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:09:02.016866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:02.017159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:02.017439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:02.034451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:09:02.035686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:09:02.093658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 761/1508] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:09:02.103048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:02.104461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:09:02.159887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c5487d-f236-47d9-8550-7dee80b26291 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:02.163436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd6d54-3e43-4283-8e2f-8b00ed8a9f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:02.164076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6d54-3e43-4283-8e2f-8b00ed8a9f55 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:02.164365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6d54-3e43-4283-8e2f-8b00ed8a9f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:02.164637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd6d54-3e43-4283-8e2f-8b00ed8a9f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:02.173260 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd6d54-3e43-4283-8e2f-8b00ed8a9f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:02.174679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd6d54-3e43-4283-8e2f-8b00ed8a9f55 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:02.184224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 748/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:09:02.504127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:09:02.505622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:09:02.518623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e12b08-6944-4bab-9709-a95f0c3fd873 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:09:02.524096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:09:02.524240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:09:02.524504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:09:02.525392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] PATH_INFO: `/v3/projects/137987f88ec44d1db8ff17e3fd745c0e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:09:02.526613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=137987f88ec44d1db8ff17e3fd745c0e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:09:02.527672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:09:02.527672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:09:02.527672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:09:02.528876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:09:02.588924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137987f88ec44d1db8ff17e3fd745c0e', 'request_id': 'req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:02.594855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137987f88ec44d1db8ff17e3fd745c0e', 'request_id': 'req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:02.607837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137987f88ec44d1db8ff17e3fd745c0e', 'request_id': 'req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:02.621695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] The token cache is being invalidate because project 137987f88ec44d1db8ff17e3fd745c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:09:02.622014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:02.622763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c1734a1e-a4d2-4d74-9b7d-6b69ef7d9618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:09:02.624433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 762/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:09:02 2022] DELETE /identity/v3/projects/137987f88ec44d1db8ff17e3fd745c0e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:09:12.179852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:09:12.618684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:10:50.020169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536f5d7-087c-42f0-b478-270fc6dfd1f9 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:50.020737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536f5d7-087c-42f0-b478-270fc6dfd1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:50.020737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9536f5d7-087c-42f0-b478-270fc6dfd1f9 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:50.022195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:10:50.026920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a10d7-a74f-456b-8e11-0f09ebdf3e8e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:50.027323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a10d7-a74f-456b-8e11-0f09ebdf3e8e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:50.027477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a10d7-a74f-456b-8e11-0f09ebdf3e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:50.045020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-522a10d7-a74f-456b-8e11-0f09ebdf3e8e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:10:50.046214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-522a10d7-a74f-456b-8e11-0f09ebdf3e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:10:50.104987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:10:50.275777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536f5d7-087c-42f0-b478-270fc6dfd1f9 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:10:50.277405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9536f5d7-087c-42f0-b478-270fc6dfd1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:10:50.351181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9536f5d7-087c-42f0-b478-270fc6dfd1f9 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:10:50.356418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aac559-bd76-4510-b93f-35a7d9161a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:10:50.357051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aac559-bd76-4510-b93f-35a7d9161a6b service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:50.357334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aac559-bd76-4510-b93f-35a7d9161a6b service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:50.357608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aac559-bd76-4510-b93f-35a7d9161a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:50.365480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aac559-bd76-4510-b93f-35a7d9161a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:10:50.367089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aac559-bd76-4510-b93f-35a7d9161a6b service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:10:50.376183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 750/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:10:51.260687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc349-1c66-4d80-bd90-3577dec0bb8e None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:51.261243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc349-1c66-4d80-bd90-3577dec0bb8e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:51.261243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cc349-1c66-4d80-bd90-3577dec0bb8e None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:51.262617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:10:51.267379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc65ae-50f1-4208-921f-d856cdf103a5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:51.267835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc65ae-50f1-4208-921f-d856cdf103a5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:51.267944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc65ae-50f1-4208-921f-d856cdf103a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:51.285982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-97dc65ae-50f1-4208-921f-d856cdf103a5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:10:51.287749 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-97dc65ae-50f1-4208-921f-d856cdf103a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:10:51.295520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:10:51.444373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc349-1c66-4d80-bd90-3577dec0bb8e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:10:51.458367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cc349-1c66-4d80-bd90-3577dec0bb8e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:10:51.465995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a3da-ef2a-46b2-9dc6-1872cd6ccc50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:10:51.466649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a3da-ef2a-46b2-9dc6-1872cd6ccc50 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:51.466962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a3da-ef2a-46b2-9dc6-1872cd6ccc50 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:51.467245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a3da-ef2a-46b2-9dc6-1872cd6ccc50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:51.478348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a3da-ef2a-46b2-9dc6-1872cd6ccc50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:10:51.479967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a3da-ef2a-46b2-9dc6-1872cd6ccc50 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:10:51.489187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 765/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:10:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:10:51.741886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47d07-904f-483b-abc0-3b68906af673 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:51.742200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47d07-904f-483b-abc0-3b68906af673 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:51.742486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e47d07-904f-483b-abc0-3b68906af673 None None] PATH_INFO: `/v3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:51.743880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 752/1517] 10.222.0.15 () {54 vars in 925 bytes} [Thu May 26 20:10:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:10:51.750545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79176-367d-461d-95d1-37092ab5e480 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:51.750864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79176-367d-461d-95d1-37092ab5e480 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:51.751149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b79176-367d-461d-95d1-37092ab5e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:51.769663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-38b79176-367d-461d-95d1-37092ab5e480 None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:10:51.770821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-38b79176-367d-461d-95d1-37092ab5e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:10:51.833283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 766/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Thu May 26 20:10:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:10:55.759697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86026c08-276d-42cf-bc36-9177a18c9f87 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:55.760207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86026c08-276d-42cf-bc36-9177a18c9f87 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:55.760207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86026c08-276d-42cf-bc36-9177a18c9f87 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:55.761539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 753/1519] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 26 20:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:10:55.766392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c57c4-9a4c-4c8a-a06d-54a887e51517 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:55.766833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c57c4-9a4c-4c8a-a06d-54a887e51517 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:55.767018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c57c4-9a4c-4c8a-a06d-54a887e51517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:55.785161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-790c57c4-9a4c-4c8a-a06d-54a887e51517 None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:10:55.786353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-790c57c4-9a4c-4c8a-a06d-54a887e51517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:10:55.794704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 767/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 26 20:10:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:10:55.802436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86026c08-276d-42cf-bc36-9177a18c9f87 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:10:55.815841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86026c08-276d-42cf-bc36-9177a18c9f87 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:10:55.821213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a80f70-0dcd-47b3-9114-a7552e31f746 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:10:55.821848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80f70-0dcd-47b3-9114-a7552e31f746 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:10:55.822130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80f70-0dcd-47b3-9114-a7552e31f746 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:10:55.822409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a80f70-0dcd-47b3-9114-a7552e31f746 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:10:55.830473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80f70-0dcd-47b3-9114-a7552e31f746 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:10:55.832106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a80f70-0dcd-47b3-9114-a7552e31f746 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:10:55.842127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 754/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:10:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:11:02.773270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefaedd-a6fc-4656-8e37-6eb7ecec438e None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:02.773822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefaedd-a6fc-4656-8e37-6eb7ecec438e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:02.773932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beefaedd-a6fc-4656-8e37-6eb7ecec438e None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:02.775238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:11:02.780088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfcab-003f-47aa-9c95-16da68968885 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:02.780515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfcab-003f-47aa-9c95-16da68968885 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:02.780674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dfcab-003f-47aa-9c95-16da68968885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:02.798416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-144dfcab-003f-47aa-9c95-16da68968885 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:11:02.799575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-144dfcab-003f-47aa-9c95-16da68968885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:02.807818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:11:02.961929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefaedd-a6fc-4656-8e37-6eb7ecec438e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:11:02.976061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beefaedd-a6fc-4656-8e37-6eb7ecec438e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:11:02.981355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee97f047-cef5-4ed6-bc72-1c02531bbca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:11:02.981994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97f047-cef5-4ed6-bc72-1c02531bbca3 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:02.982271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97f047-cef5-4ed6-bc72-1c02531bbca3 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:02.982543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee97f047-cef5-4ed6-bc72-1c02531bbca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:02.992010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97f047-cef5-4ed6-bc72-1c02531bbca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:11:02.993615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee97f047-cef5-4ed6-bc72-1c02531bbca3 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:11:03.012622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 769/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:11:03.886175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ba902-aee7-432a-ae38-83d7a7811902 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:03.886735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ba902-aee7-432a-ae38-83d7a7811902 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:03.886735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915ba902-aee7-432a-ae38-83d7a7811902 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:03.888203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 20:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:11:03.893023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e006-d765-4976-9f66-64e10260cbe0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:03.893413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e006-d765-4976-9f66-64e10260cbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:03.893583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2e006-d765-4976-9f66-64e10260cbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:03.911729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-46f2e006-d765-4976-9f66-64e10260cbe0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:11:03.912924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-46f2e006-d765-4976-9f66-64e10260cbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:03.920702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 20:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:11:04.068851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ba902-aee7-432a-ae38-83d7a7811902 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:11:04.083411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915ba902-aee7-432a-ae38-83d7a7811902 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:11:04.089613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b41bb1-b98e-4193-b679-f337a68853dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:11:04.090253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41bb1-b98e-4193-b679-f337a68853dd service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:04.090667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41bb1-b98e-4193-b679-f337a68853dd service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:04.090971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b41bb1-b98e-4193-b679-f337a68853dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:04.099058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b41bb1-b98e-4193-b679-f337a68853dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:11:04.100661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b41bb1-b98e-4193-b679-f337a68853dd service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:11:04.109805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 757/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:11:08.337971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49778c-5626-43fa-98e9-02d016d22266 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:08.338547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49778c-5626-43fa-98e9-02d016d22266 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:08.338547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49778c-5626-43fa-98e9-02d016d22266 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:08.339915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:11:08.346032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890db3b-4fe4-466a-ba63-08c6350adfbb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:08.346497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890db3b-4fe4-466a-ba63-08c6350adfbb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:08.346624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890db3b-4fe4-466a-ba63-08c6350adfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:08.364917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9890db3b-4fe4-466a-ba63-08c6350adfbb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:11:08.366111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9890db3b-4fe4-466a-ba63-08c6350adfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:08.374335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:11:08.410180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49778c-5626-43fa-98e9-02d016d22266 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:11:08.411934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1d49778c-5626-43fa-98e9-02d016d22266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:08.468721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49778c-5626-43fa-98e9-02d016d22266 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:11:08.472278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9fe0fc-f966-4c40-814a-4c1abc0ce4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:11:08.472919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fe0fc-f966-4c40-814a-4c1abc0ce4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:08.473205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fe0fc-f966-4c40-814a-4c1abc0ce4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:08.473506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9fe0fc-f966-4c40-814a-4c1abc0ce4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:08.482795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fe0fc-f966-4c40-814a-4c1abc0ce4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:11:08.484243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9fe0fc-f966-4c40-814a-4c1abc0ce4c5 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:11:08.489084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:11:08.494740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 772/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:11:10.723481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923ddc-4751-4df4-b92b-bbe0a801df73 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:10.724278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923ddc-4751-4df4-b92b-bbe0a801df73 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:10.724278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef923ddc-4751-4df4-b92b-bbe0a801df73 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:10.725406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:11:10.730636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be629fd2-26bd-4418-ad41-9e230bd70eab None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:10.731137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be629fd2-26bd-4418-ad41-9e230bd70eab None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:10.731265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be629fd2-26bd-4418-ad41-9e230bd70eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:10.749066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-be629fd2-26bd-4418-ad41-9e230bd70eab None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:11:10.750245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-be629fd2-26bd-4418-ad41-9e230bd70eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:10.758372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:11:10.794220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923ddc-4751-4df4-b92b-bbe0a801df73 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:11:10.795952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ef923ddc-4751-4df4-b92b-bbe0a801df73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:10.809120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef923ddc-4751-4df4-b92b-bbe0a801df73 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:11:10.812848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57287b-a4e9-433f-88f4-d711077f49fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:11:10.813480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57287b-a4e9-433f-88f4-d711077f49fc service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:10.813765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57287b-a4e9-433f-88f4-d711077f49fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:10.814039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57287b-a4e9-433f-88f4-d711077f49fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:10.823644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57287b-a4e9-433f-88f4-d711077f49fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:11:10.825076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c57287b-a4e9-433f-88f4-d711077f49fc service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:11:10.834356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 760/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:11:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:11:14.642529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c429b0-ae32-4cf3-aadb-0140e98475ee None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:14.643000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c429b0-ae32-4cf3-aadb-0140e98475ee None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:14.643153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c429b0-ae32-4cf3-aadb-0140e98475ee None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:14.644531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:11:14.650374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae989ec-1b1a-465c-91eb-5d0a5e1f2960 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:14.650803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae989ec-1b1a-465c-91eb-5d0a5e1f2960 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:14.650986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae989ec-1b1a-465c-91eb-5d0a5e1f2960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:14.657392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=62 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:11:14.670804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2ae989ec-1b1a-465c-91eb-5d0a5e1f2960 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:11:14.672018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2ae989ec-1b1a-465c-91eb-5d0a5e1f2960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:14.679747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:11:14.958043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c429b0-ae32-4cf3-aadb-0140e98475ee None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:11:14.959778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-84c429b0-ae32-4cf3-aadb-0140e98475ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:15.026407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c429b0-ae32-4cf3-aadb-0140e98475ee None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:11:15.029981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daea541a-e512-48f7-ae57-c9542174bbb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:11:15.030630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea541a-e512-48f7-ae57-c9542174bbb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:15.030944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea541a-e512-48f7-ae57-c9542174bbb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:15.031227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daea541a-e512-48f7-ae57-c9542174bbb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:15.040330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea541a-e512-48f7-ae57-c9542174bbb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:11:15.041759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daea541a-e512-48f7-ae57-c9542174bbb7 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:11:15.050967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 775/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:11:17.285543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82289c-578f-4d7d-8bd9-b6a6a2809162 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:17.286132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82289c-578f-4d7d-8bd9-b6a6a2809162 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:17.286132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df82289c-578f-4d7d-8bd9-b6a6a2809162 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:17.287525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 20:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:11:17.292990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c314-e4ce-419b-b90e-163a0fdab8b4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:17.293426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c314-e4ce-419b-b90e-163a0fdab8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:17.293556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501c314-e4ce-419b-b90e-163a0fdab8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:17.311629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c501c314-e4ce-419b-b90e-163a0fdab8b4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:11:17.312849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c501c314-e4ce-419b-b90e-163a0fdab8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:17.321213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 20:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:11:17.591936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82289c-578f-4d7d-8bd9-b6a6a2809162 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:11:17.593615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-df82289c-578f-4d7d-8bd9-b6a6a2809162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:11:17.606375 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df82289c-578f-4d7d-8bd9-b6a6a2809162 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:11:17.609840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd5885-798b-45e6-a968-a6e3a4078e0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:11:17.610479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd5885-798b-45e6-a968-a6e3a4078e0a service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:11:17.610763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd5885-798b-45e6-a968-a6e3a4078e0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:11:17.611068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd5885-798b-45e6-a968-a6e3a4078e0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:11:17.620322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd5885-798b-45e6-a968-a6e3a4078e0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:11:17.621745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd5885-798b-45e6-a968-a6e3a4078e0a service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:11:17.633798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 763/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:11:27.306081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=32 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:11:27.627034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=8 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:56.042506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a35b-3e76-48e4-bd98-5e791281a900 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.044894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a35b-3e76-48e4-bd98-5e791281a900 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.044894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46a35b-3e76-48e4-bd98-5e791281a900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.083274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3e46a35b-3e76-48e4-bd98-5e791281a900 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.084538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3e46a35b-3e76-48e4-bd98-5e791281a900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.099019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 777/1540] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:56.109974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d5e6a-90fa-4089-a509-c4f84127b539 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.110586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d5e6a-90fa-4089-a509-c4f84127b539 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.110586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d5e6a-90fa-4089-a509-c4f84127b539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.139145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a01d5e6a-90fa-4089-a509-c4f84127b539 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.140385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a01d5e6a-90fa-4089-a509-c4f84127b539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.152602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 764/1541] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:56.157575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a35b-3e76-48e4-bd98-5e791281a900 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.168502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46a35b-3e76-48e4-bd98-5e791281a900 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.178564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.179283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.179574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.179850 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.180589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:56.180898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.182547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.198865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 778/1542] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:12:56.207152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d5e6a-90fa-4089-a509-c4f84127b539 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.220588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d5e6a-90fa-4089-a509-c4f84127b539 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.229220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e92951-7b0d-4bda-9b9c-5369d57acb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.230067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92951-7b0d-4bda-9b9c-5369d57acb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.230360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92951-7b0d-4bda-9b9c-5369d57acb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.230806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e92951-7b0d-4bda-9b9c-5369d57acb5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.231540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e92951-7b0d-4bda-9b9c-5369d57acb5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.233443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e92951-7b0d-4bda-9b9c-5369d57acb5d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.289919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 765/1543] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:56.293716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.307238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d56956-d1b7-4882-b507-2830e336e13c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.351095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc20918-e4c0-4627-8bdc-5d09a3045765 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.351506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc20918-e4c0-4627-8bdc-5d09a3045765 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.351690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc20918-e4c0-4627-8bdc-5d09a3045765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.381732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb068c-0d06-46cc-8941-1735830ec139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.383339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb068c-0d06-46cc-8941-1735830ec139 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.383915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb068c-0d06-46cc-8941-1735830ec139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.384408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb068c-0d06-46cc-8941-1735830ec139 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.385317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb068c-0d06-46cc-8941-1735830ec139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.387874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb068c-0d06-46cc-8941-1735830ec139 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.392094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6dc20918-e4c0-4627-8bdc-5d09a3045765 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.393337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6dc20918-e4c0-4627-8bdc-5d09a3045765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.418969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 766/1544] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 26 20:12:56.420320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52069c41-f40c-450d-9b72-b16c4a4cfb48 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.420603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52069c41-f40c-450d-9b72-b16c4a4cfb48 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.420880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52069c41-f40c-450d-9b72-b16c4a4cfb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.442905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 779/1545] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:56.445769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59480c9-5d37-432b-9920-913d3be751a2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.446351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59480c9-5d37-432b-9920-913d3be751a2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.446908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59480c9-5d37-432b-9920-913d3be751a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.456893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-52069c41-f40c-450d-9b72-b16c4a4cfb48 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.466145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-52069c41-f40c-450d-9b72-b16c4a4cfb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.481441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 767/1546] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:56.482296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52069c41-f40c-450d-9b72-b16c4a4cfb48 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.495977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b59480c9-5d37-432b-9920-913d3be751a2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.497207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b59480c9-5d37-432b-9920-913d3be751a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.500622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52069c41-f40c-450d-9b72-b16c4a4cfb48 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.507647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.508892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.509183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.509465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.510198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.512040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.532651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 780/1547] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:56.534221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf6a0-c948-4ee2-a4e9-4139343278be None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.534517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf6a0-c948-4ee2-a4e9-4139343278be None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.534800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf6a0-c948-4ee2-a4e9-4139343278be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.535922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 768/1548] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:56.541807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.561890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf84b50-8b64-44b0-ab0a-f88d8f04210a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.571557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.571557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.571557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.571932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.572016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2fdcf6a0-c948-4ee2-a4e9-4139343278be None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.572547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:56.572866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.573076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2fdcf6a0-c948-4ee2-a4e9-4139343278be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.574028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 20:12:56.574028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 26 20:12:56.574028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: May 26 20:12:56.575090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.602755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 769/1549] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:12:56.603538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.616753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 781/1550] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:56.618278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ed4-c80e-496a-af52-28bb3374b6e8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.618717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ed4-c80e-496a-af52-28bb3374b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.618924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ed4-c80e-496a-af52-28bb3374b6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.634895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde01828-1a34-422a-80d5-398adb33b951 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.640191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.644142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.644142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.644142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.651825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.653602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.680354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c5e68ed4-c80e-496a-af52-28bb3374b6e8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.681613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c5e68ed4-c80e-496a-af52-28bb3374b6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.695959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 770/1551] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:56.696922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.721905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3824739b-b19c-484c-8389-57f3084f51f4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.724276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 782/1552] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:56.725696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68ed4-c80e-496a-af52-28bb3374b6e8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.730132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.731154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.731449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.731726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.732423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.734697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.753911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68ed4-c80e-496a-af52-28bb3374b6e8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.781626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ebf42-033a-49ff-908c-2383f5ad5039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.782326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ebf42-033a-49ff-908c-2383f5ad5039 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.782618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ebf42-033a-49ff-908c-2383f5ad5039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.782919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ebf42-033a-49ff-908c-2383f5ad5039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.783803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ebf42-033a-49ff-908c-2383f5ad5039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:56.784121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ebf42-033a-49ff-908c-2383f5ad5039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.785768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ebf42-033a-49ff-908c-2383f5ad5039 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.804262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 771/1553] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:56.804723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.816154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 783/1554] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:12:56.817199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7d4-ac31-403a-8d16-d39d9164d1bd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.817493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7d4-ac31-403a-8d16-d39d9164d1bd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.817774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56f7d4-ac31-403a-8d16-d39d9164d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.852738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1d56f7d4-ac31-403a-8d16-d39d9164d1bd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.853951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1d56f7d4-ac31-403a-8d16-d39d9164d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.887668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12abfc5-1a9c-4f90-bbde-08a9527b56ee admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.892261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497969e-2e73-46ed-854d-e611bfb74df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.893163 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497969e-2e73-46ed-854d-e611bfb74df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.893447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497969e-2e73-46ed-854d-e611bfb74df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.893721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497969e-2e73-46ed-854d-e611bfb74df1 admin admin] PATH_INFO: `/v3/projects/f0b22885026a421ea8be652d9f39aa6a/users/8e15218966314337ae4d70e374bd4bbe/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.908270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497969e-2e73-46ed-854d-e611bfb74df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b22885026a421ea8be652d9f39aa6a, user_id=8e15218966314337ae4d70e374bd4bbe, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.910924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497969e-2e73-46ed-854d-e611bfb74df1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:56.918092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 784/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:56.919047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f7d4-ac31-403a-8d16-d39d9164d1bd None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:56.928599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56f7d4-ac31-403a-8d16-d39d9164d1bd None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:56.928799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 772/1556] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:56 2022] PUT /identity/v3/projects/f0b22885026a421ea8be652d9f39aa6a/users/8e15218966314337ae4d70e374bd4bbe/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:56.930183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b06-fae4-47a0-97e7-27e03cbbcb07 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.930477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b06-fae4-47a0-97e7-27e03cbbcb07 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.930753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1004b06-fae4-47a0-97e7-27e03cbbcb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.949016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a1004b06-fae4-47a0-97e7-27e03cbbcb07 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:56.950207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a1004b06-fae4-47a0-97e7-27e03cbbcb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:56.967049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:56.989912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:56.990109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46dd3-2062-4eef-aa8d-99da92c59469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:56.990711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46dd3-2062-4eef-aa8d-99da92c59469 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:56.991003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46dd3-2062-4eef-aa8d-99da92c59469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:56.991479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46dd3-2062-4eef-aa8d-99da92c59469 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:56.992173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46dd3-2062-4eef-aa8d-99da92c59469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:56.994150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46dd3-2062-4eef-aa8d-99da92c59469 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.011263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 773/1557] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.012299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004b06-fae4-47a0-97e7-27e03cbbcb07 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.016215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 785/1558] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:56 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.016215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b95a9-afdc-4554-83b2-04bcf59ff796 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.016215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b95a9-afdc-4554-83b2-04bcf59ff796 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.016215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09b95a9-afdc-4554-83b2-04bcf59ff796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.022391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1004b06-fae4-47a0-97e7-27e03cbbcb07 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.027045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aefa34-9167-4334-a422-c8a6d920c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.027922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefa34-9167-4334-a422-c8a6d920c994 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.028219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefa34-9167-4334-a422-c8a6d920c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.028510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aefa34-9167-4334-a422-c8a6d920c994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.029194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aefa34-9167-4334-a422-c8a6d920c994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.031152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aefa34-9167-4334-a422-c8a6d920c994 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.038258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c09b95a9-afdc-4554-83b2-04bcf59ff796 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.039517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c09b95a9-afdc-4554-83b2-04bcf59ff796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.047480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 786/1559] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.049019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c1eb-0d81-4508-a71f-b99d30300b8c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.049341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c1eb-0d81-4508-a71f-b99d30300b8c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.049611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1c1eb-0d81-4508-a71f-b99d30300b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.068639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 774/1560] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.068863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3ec1c1eb-0d81-4508-a71f-b99d30300b8c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.070133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d95fb-6ab7-4acc-924a-ed50a9f42fa3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.070260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3ec1c1eb-0d81-4508-a71f-b99d30300b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.070537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d95fb-6ab7-4acc-924a-ed50a9f42fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.070925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d95fb-6ab7-4acc-924a-ed50a9f42fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.093105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ac0d95fb-6ab7-4acc-924a-ed50a9f42fa3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.094636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ac0d95fb-6ab7-4acc-924a-ed50a9f42fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.152234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 787/1561] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.153408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c1eb-0d81-4508-a71f-b99d30300b8c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.162626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1c1eb-0d81-4508-a71f-b99d30300b8c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.165048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 775/1562] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.166358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c586b7-45bd-4ebe-b9eb-239ce4f77171 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.166645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c586b7-45bd-4ebe-b9eb-239ce4f77171 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.166951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c586b7-45bd-4ebe-b9eb-239ce4f77171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.172533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.173258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.173610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.173890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.174644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:57.174998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.176637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.187401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-67c586b7-45bd-4ebe-b9eb-239ce4f77171 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.188602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-67c586b7-45bd-4ebe-b9eb-239ce4f77171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.199696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 788/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:12:57.199696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.201269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 776/1564] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.202714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00eed7-822e-485b-bc50-4c6176fcda69 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.203133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00eed7-822e-485b-bc50-4c6176fcda69 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.203517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00eed7-822e-485b-bc50-4c6176fcda69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.209491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9bfeb-de96-4f1d-a808-3a4c6ffedb53 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.214422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf683e-1c55-4073-8672-8aaa639bfd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.215121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf683e-1c55-4073-8672-8aaa639bfd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.215459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf683e-1c55-4073-8672-8aaa639bfd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.215730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf683e-1c55-4073-8672-8aaa639bfd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.216451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf683e-1c55-4073-8672-8aaa639bfd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.218063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf683e-1c55-4073-8672-8aaa639bfd87 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.223530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7a00eed7-822e-485b-bc50-4c6176fcda69 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.224922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7a00eed7-822e-485b-bc50-4c6176fcda69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.228732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 789/1565] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:57.229960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57916-ad71-4ad8-afd9-65cdd25f263c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.230249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57916-ad71-4ad8-afd9-65cdd25f263c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.230524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a57916-ad71-4ad8-afd9-65cdd25f263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.235714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 777/1566] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.236470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00eed7-822e-485b-bc50-4c6176fcda69 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.245482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00eed7-822e-485b-bc50-4c6176fcda69 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.249900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4dad0-c1f1-4dd7-8b62-1c2755070e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.250533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-01a57916-ad71-4ad8-afd9-65cdd25f263c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.250666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4dad0-c1f1-4dd7-8b62-1c2755070e08 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.250812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4dad0-c1f1-4dd7-8b62-1c2755070e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.251117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4dad0-c1f1-4dd7-8b62-1c2755070e08 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.251766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-01a57916-ad71-4ad8-afd9-65cdd25f263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.251887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4dad0-c1f1-4dd7-8b62-1c2755070e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.252786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-fca4dad0-c1f1-4dd7-8b62-1c2755070e08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:12:57.252786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 26 20:12:57.252786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: May 26 20:12:57.253966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4dad0-c1f1-4dd7-8b62-1c2755070e08 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.260043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 790/1567] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.261234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c44d2-1bcc-4fa0-9aca-c0b6388d822b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.261518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c44d2-1bcc-4fa0-9aca-c0b6388d822b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.261793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c44d2-1bcc-4fa0-9aca-c0b6388d822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.275957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 778/1568] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.277652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2391e-c0d4-4b09-985a-4333391939d2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.277947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2391e-c0d4-4b09-985a-4333391939d2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.278287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa2391e-c0d4-4b09-985a-4333391939d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.282496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d56c44d2-1bcc-4fa0-9aca-c0b6388d822b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.283719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d56c44d2-1bcc-4fa0-9aca-c0b6388d822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.291565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 791/1569] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.292316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c44d2-1bcc-4fa0-9aca-c0b6388d822b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.295847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2fa2391e-c0d4-4b09-985a-4333391939d2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.297159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2fa2391e-c0d4-4b09-985a-4333391939d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.301320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c44d2-1bcc-4fa0-9aca-c0b6388d822b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.305719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 779/1570] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.306315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2391e-c0d4-4b09-985a-4333391939d2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.306538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.307219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.307500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.307774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.308448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.309721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:12:57.309721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:12:57.309721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:12:57.310927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.337423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 792/1571] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.338481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.360137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa2391e-c0d4-4b09-985a-4333391939d2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.402156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:57.411140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.412323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.412898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.413180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.414187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226002-1877-4c85-98bb-d46395dfd734 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.419936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.420610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.420888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.421577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.422310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.423962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.426252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:57.429886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.436406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.445528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 793/1572] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:57.445528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.445816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 780/1573] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:12:57.448198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.455864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82943b0c-3b94-46b7-8058-394f3613472f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.460951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.461702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.462181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.462530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.462949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347333e-1d1e-4dcd-8a65-c7f5cc071b79 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.463442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:57.463817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.465677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.468074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.468912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.469415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.469668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.470545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:57.470880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.472617 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.485848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 794/1574] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:12:57.487008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.488082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 781/1575] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:12:57.489199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.499571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218e293-d5b1-4d3b-9be1-4b33343e3b85 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.503381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd27ab3-75a7-4100-9779-de73b96666e6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.505069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.506489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.506778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.507157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.507948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.508939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.509606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.509772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.510174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.510459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.511227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:57.511700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.513697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.520815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 795/1576] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:57.521560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.537210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 782/1577] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:12:57.537210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.537544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5996ce10-a1e0-4281-80ab-830ad9cfa894 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.543106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.543886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.544272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.545045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.545493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:12:57.545889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.547609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.549052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12778939-0048-4865-89ce-1d209fe3ceca admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.554724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.555928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.555928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.556167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.556844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.559060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.562037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 796/1578] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:12:57.562964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.574220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858b22b-b088-46e3-a77c-1d0c5058d06f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.579562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.580668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.581023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.581349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] PATH_INFO: `/v3/projects/a27e083cb6b845fea8b7a2cee00ee34f/users/13a00d0c317a4e69aa84b3851d5f0424/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.582923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 783/1579] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/users => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.583659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.596633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0bbbe-cbed-4be7-b84c-c0fcccc78d0d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.598252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a27e083cb6b845fea8b7a2cee00ee34f, user_id=13a00d0c317a4e69aa84b3851d5f0424, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.599652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:12:57.599652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:12:57.599652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:12:57.601650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.601884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.602370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.602650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.602962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.603689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.605685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.616800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 797/1580] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:57 2022] PUT /identity/v3/projects/a27e083cb6b845fea8b7a2cee00ee34f/users/13a00d0c317a4e69aa84b3851d5f0424/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:57.617526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.656358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 784/1581] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/projects => generated 379 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.657572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.699924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1cfb-1e31-4beb-984d-04e7e4fafa75 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.741030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1d986-93c6-4e3f-9709-774ebcbd3d75 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.746461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.747489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.747909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.748282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.749236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.751418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.764050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.764720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.764999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.765270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.765968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.770717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.770917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 785/1582] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:57.770917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.781223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f97f6-8d19-41ea-a738-a776017e3f73 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.786079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.787389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.787699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.787983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.788732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.790829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.806984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 798/1583] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.808500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.828517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 786/1584] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.829437 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.846912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:57.883716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a0b90-6dcc-46b2-b76c-c95d237b420b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.891151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:57.902911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435acb1c-3084-4d86-9bda-1b6d0560a968 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.908490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7dc379-e7e5-4465-9a98-252882167a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.909498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc379-e7e5-4465-9a98-252882167a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.909850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc379-e7e5-4465-9a98-252882167a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.910194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7dc379-e7e5-4465-9a98-252882167a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.911580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dc379-e7e5-4465-9a98-252882167a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.913909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7dc379-e7e5-4465-9a98-252882167a6e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.928185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 787/1585] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:57.928185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4d72-6a16-4fe7-96c2-88b3221446e7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.928185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4d72-6a16-4fe7-96c2-88b3221446e7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.928185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be4d72-6a16-4fe7-96c2-88b3221446e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.947408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-01be4d72-6a16-4fe7-96c2-88b3221446e7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:57.948756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-01be4d72-6a16-4fe7-96c2-88b3221446e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:57.959763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.959990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 788/1586] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:57.960112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.960212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be4d72-6a16-4fe7-96c2-88b3221446e7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:57.960427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.960427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.960427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.961113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.970086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be4d72-6a16-4fe7-96c2-88b3221446e7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:57.975847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:57.976599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:57.976952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:57.977296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:57.978051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:57.980211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:57.996567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 799/1587] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:57.996567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.010770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 789/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:57 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:58.010770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.019127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c32bc-f2de-45f8-a1c9-79d724a8b1b5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.071960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6298680-0bfa-4e2d-9494-0de43a6dd811 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.077055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.078028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.078678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.078858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] PATH_INFO: `/v3/projects/05170ebf4ce940fbb8f8d5396ab2fa68/users/60112f9283334d30be3c64eb6406200a/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.081724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.082644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.083028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.083374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.084681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.086860 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.096426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] RBAC: Authorizing `identity:create_grant(project_id=05170ebf4ce940fbb8f8d5396ab2fa68, user_id=60112f9283334d30be3c64eb6406200a, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.099434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.110716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 790/1589] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:58 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:58.111946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.117429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 800/1590] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:57 2022] PUT /identity/v3/projects/05170ebf4ce940fbb8f8d5396ab2fa68/users/60112f9283334d30be3c64eb6406200a/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:58.123297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be929f87-5b3d-4804-a5e1-680d86b05a8a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.128358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.180683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:58.190140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.190806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.191114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.191388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.192083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.194640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.202050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed02056-24a8-4bec-89e8-133da86c165e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.207598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.210930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.210930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.210930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.211734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.218042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.223146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 791/1591] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:58 2022] POST /identity/v3/users => generated 282 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:58.224646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.232179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 801/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.232950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.244060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa8a38-ccfc-401b-9e04-32c90f7ab93c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.248780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.249456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.249743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.250018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.250756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.253391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.284969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:58.285158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 802/1593] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:58 2022] POST /identity/v3/users => generated 293 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:58.286047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.297956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c803cad-d48b-44e0-b117-2acc9234b71d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.299471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdf8d1-1a8a-40d9-8bef-bd65fae08451 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.303319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf0f368-09df-4902-b6a8-a7e3e964c3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.304150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f368-09df-4902-b6a8-a7e3e964c3ff service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.304583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f368-09df-4902-b6a8-a7e3e964c3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.305031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf0f368-09df-4902-b6a8-a7e3e964c3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.305220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.306135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.306531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.306938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.308036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.310028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.321775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0f368-09df-4902-b6a8-a7e3e964c3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.326435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 803/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.326591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf0f368-09df-4902-b6a8-a7e3e964c3ff service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.326698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.335161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873330a0-07a5-42d2-9ae1-f8724f32a905 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.336151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 792/1595] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:12:58.337646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891893-efd9-4b4f-9ced-b418cae98009 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.337966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891893-efd9-4b4f-9ced-b418cae98009 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.338531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65891893-efd9-4b4f-9ced-b418cae98009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.341889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.342818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.343228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.343632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.344512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.346262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.357503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 804/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.358290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.370619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0520db-4b25-4b7c-987b-6ab585366e86 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.375110 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-65891893-efd9-4b4f-9ced-b418cae98009 None None] MFA Rules not processed for user `60112f9283334d30be3c64eb6406200a`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:58.376887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.377064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-65891893-efd9-4b4f-9ced-b418cae98009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:58.377163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.377262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.377520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.378571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.381187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.399083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 805/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.400197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.412984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245e0ae-a9bd-4b49-a74f-43496a9ee88c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.418218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.419590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.419897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.420164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] PATH_INFO: `/v3/projects/cd0f198bae8f4cb684f6451ceaec00f9/users/a230f046950d49109c1f6b9970384eec/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.441400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0f198bae8f4cb684f6451ceaec00f9, user_id=a230f046950d49109c1f6b9970384eec, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.446061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.470916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 806/1598] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:58 2022] PUT /identity/v3/projects/cd0f198bae8f4cb684f6451ceaec00f9/users/a230f046950d49109c1f6b9970384eec/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:58.472292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.483736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 793/1599] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:58.484927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891893-efd9-4b4f-9ced-b418cae98009 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.499911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65891893-efd9-4b4f-9ced-b418cae98009 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.603682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.605000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.605383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.605755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.607058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.608974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.609506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db0b3d-9d10-43b5-85b1-60d837c1b8e7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.617331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.618023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.618311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.618673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.619919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.625752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 794/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.626701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.627996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.643107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a1a8c-419d-4029-8df2-12fd89c1f023 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.645671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 807/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.647455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.655759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5921bfb-cec4-486f-8ddd-1d92dab2a219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.658413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921bfb-cec4-486f-8ddd-1d92dab2a219 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.658822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921bfb-cec4-486f-8ddd-1d92dab2a219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.659286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5921bfb-cec4-486f-8ddd-1d92dab2a219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.660231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67dd6-3e3f-4211-ae87-1f052ff9724f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.661536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5921bfb-cec4-486f-8ddd-1d92dab2a219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.663426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5921bfb-cec4-486f-8ddd-1d92dab2a219 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.665270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9e97e-546c-49fc-b621-98c74513e777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.666018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e97e-546c-49fc-b621-98c74513e777 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.666591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e97e-546c-49fc-b621-98c74513e777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.666903 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9e97e-546c-49fc-b621-98c74513e777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.668277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9e97e-546c-49fc-b621-98c74513e777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.669971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9e97e-546c-49fc-b621-98c74513e777 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.684880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 795/1602] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.686497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 808/1603] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.687382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cf51f-0dbd-4cbd-abb9-99a2f69ac4f4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.687911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cf51f-0dbd-4cbd-abb9-99a2f69ac4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.688243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d25b6-f980-43b4-8a5e-89bd84a76da5 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.688378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50cf51f-0dbd-4cbd-abb9-99a2f69ac4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.688544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d25b6-f980-43b4-8a5e-89bd84a76da5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.688831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d25b6-f980-43b4-8a5e-89bd84a76da5 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.690598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 809/1604] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 20:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:12:58.691413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d25b6-f980-43b4-8a5e-89bd84a76da5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.705482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d25b6-f980-43b4-8a5e-89bd84a76da5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.714138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.715138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.715575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.715983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] PATH_INFO: `/v3/projects/86656b5c0510472fad2eccc8147ea4d5/users/9b03f848bf5d43c8be9d2a9bff06dcd1/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.731670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b50cf51f-0dbd-4cbd-abb9-99a2f69ac4f4 None None] MFA Rules not processed for user `a230f046950d49109c1f6b9970384eec`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:58.733201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b50cf51f-0dbd-4cbd-abb9-99a2f69ac4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:58.735462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86656b5c0510472fad2eccc8147ea4d5, user_id=9b03f848bf5d43c8be9d2a9bff06dcd1, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.738682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.763144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 810/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:58 2022] PUT /identity/v3/projects/86656b5c0510472fad2eccc8147ea4d5/users/9b03f848bf5d43c8be9d2a9bff06dcd1/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:58.763144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.796447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:58.798871 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:58.819832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 796/1606] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:58.821004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cf51f-0dbd-4cbd-abb9-99a2f69ac4f4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.850068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31338fae-435b-464c-ba30-634ff9e554a1 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.861582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.863088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.863374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.865794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.866726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.869492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50cf51f-0dbd-4cbd-abb9-99a2f69ac4f4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.870673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.884141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c36bec-748f-40c6-aa4c-1e13e4349bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.886343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c36bec-748f-40c6-aa4c-1e13e4349bfa admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.887092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c36bec-748f-40c6-aa4c-1e13e4349bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.887991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c36bec-748f-40c6-aa4c-1e13e4349bfa admin admin] PATH_INFO: `/v3/projects/a04f1f262059447eb15c1dc7bba27ad3/users/bf32414823884e92b355e29ab7d4d005/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.893964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 811/1607] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:12:58.894649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:58.908489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd679c-1ef1-4a94-9f96-685a0ff5a2f7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:58.914777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c36bec-748f-40c6-aa4c-1e13e4349bfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04f1f262059447eb15c1dc7bba27ad3, user_id=bf32414823884e92b355e29ab7d4d005, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.915033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d337c-45e7-477e-88bd-f83780b7de7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:58.916025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d337c-45e7-477e-88bd-f83780b7de7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.916463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d337c-45e7-477e-88bd-f83780b7de7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.916773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d337c-45e7-477e-88bd-f83780b7de7d admin admin] PATH_INFO: `/v3/projects/969fa6291d1d45158048697c88d047d9/users/ce37b3dcbd9e4c089e848c833fedf0b3/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.918294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c36bec-748f-40c6-aa4c-1e13e4349bfa admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.937288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d337c-45e7-477e-88bd-f83780b7de7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=969fa6291d1d45158048697c88d047d9, user_id=ce37b3dcbd9e4c089e848c833fedf0b3, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:58.940006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d337c-45e7-477e-88bd-f83780b7de7d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:58.940976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 797/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:58 2022] PUT /identity/v3/projects/a04f1f262059447eb15c1dc7bba27ad3/users/bf32414823884e92b355e29ab7d4d005/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:58.942420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7948-1e1e-4106-95f1-715405298af5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.942968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7948-1e1e-4106-95f1-715405298af5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.943475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7948-1e1e-4106-95f1-715405298af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.964758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-23ef7948-1e1e-4106-95f1-715405298af5 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:58.975377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 812/1609] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:58 2022] PUT /identity/v3/projects/969fa6291d1d45158048697c88d047d9/users/ce37b3dcbd9e4c089e848c833fedf0b3/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:58.975614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-23ef7948-1e1e-4106-95f1-715405298af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:58.975726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910e11-43ae-4d49-91b5-6a21163e16dc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:58.975726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910e11-43ae-4d49-91b5-6a21163e16dc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:58.975726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68910e11-43ae-4d49-91b5-6a21163e16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:58.996393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-68910e11-43ae-4d49-91b5-6a21163e16dc None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:58.998236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-68910e11-43ae-4d49-91b5-6a21163e16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:59.061306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 798/1610] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:59.063615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e403-1f4e-4c24-b425-04b9aeda30b3 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.064280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e403-1f4e-4c24-b425-04b9aeda30b3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.064838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4e403-1f4e-4c24-b425-04b9aeda30b3 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.066873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 799/1611] 10.222.0.48 () {54 vars in 961 bytes} [Thu May 26 20:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:12:59.067602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e403-1f4e-4c24-b425-04b9aeda30b3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:59.081077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 813/1612] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:59.083031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70821-8b0b-441f-ad98-9c8ce5491171 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.083481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70821-8b0b-441f-ad98-9c8ce5491171 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.084494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70821-8b0b-441f-ad98-9c8ce5491171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.132123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-88e70821-8b0b-441f-ad98-9c8ce5491171 None None] MFA Rules not processed for user `bf32414823884e92b355e29ab7d4d005`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:59.133679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-88e70821-8b0b-441f-ad98-9c8ce5491171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:59.153635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4e403-1f4e-4c24-b425-04b9aeda30b3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:59.166162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2a3b0-819a-4b90-b0cb-98c45a9a9a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:59.167267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a3b0-819a-4b90-b0cb-98c45a9a9a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.167668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a3b0-819a-4b90-b0cb-98c45a9a9a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.167862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2a3b0-819a-4b90-b0cb-98c45a9a9a37 admin admin] PATH_INFO: `/v3/projects/ce1f32bc98a7405fadb61c4a8e838f4a/users/b5a5a5beeaa3414d916fe8ba32489855/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.186034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2a3b0-819a-4b90-b0cb-98c45a9a9a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1f32bc98a7405fadb61c4a8e838f4a, user_id=b5a5a5beeaa3414d916fe8ba32489855, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:59.189180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d2a3b0-819a-4b90-b0cb-98c45a9a9a37 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:59.209912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 800/1613] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:12:59 2022] PUT /identity/v3/projects/ce1f32bc98a7405fadb61c4a8e838f4a/users/b5a5a5beeaa3414d916fe8ba32489855/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:12:59.211023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23904da-e703-4c3d-81a8-e2d17e68879d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.211951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23904da-e703-4c3d-81a8-e2d17e68879d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.212241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23904da-e703-4c3d-81a8-e2d17e68879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.241182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d23904da-e703-4c3d-81a8-e2d17e68879d None None] MFA Rules not processed for user `ce37b3dcbd9e4c089e848c833fedf0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:59.242580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d23904da-e703-4c3d-81a8-e2d17e68879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:59.246927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 814/1614] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:59.246927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae1c6-3e6b-41a1-9916-adf7478bd135 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.246927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae1c6-3e6b-41a1-9916-adf7478bd135 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.247245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ae1c6-3e6b-41a1-9916-adf7478bd135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.270420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e21ae1c6-3e6b-41a1-9916-adf7478bd135 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:59.272462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e21ae1c6-3e6b-41a1-9916-adf7478bd135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:59.284759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:59.311842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:59.354057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 801/1615] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:59.360498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23904da-e703-4c3d-81a8-e2d17e68879d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:59.379653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 815/1616] 10.222.0.48 () {58 vars in 1058 bytes} [Thu May 26 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:59.381267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae1c6-3e6b-41a1-9916-adf7478bd135 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:59.383980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23904da-e703-4c3d-81a8-e2d17e68879d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:59.390408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d98d2-1dac-4db0-94d6-91b570080c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:59.391092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d98d2-1dac-4db0-94d6-91b570080c9e service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.391527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d98d2-1dac-4db0-94d6-91b570080c9e service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.391638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d98d2-1dac-4db0-94d6-91b570080c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.464928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ae1c6-3e6b-41a1-9916-adf7478bd135 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:59.469509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:59.470329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.472252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.474192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.553025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d98d2-1dac-4db0-94d6-91b570080c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:59.554709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d98d2-1dac-4db0-94d6-91b570080c9e service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:59.571528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 802/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:12:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:12:59.573000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e219-db7f-4af7-8bf9-a9c6fb548f86 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.573297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e219-db7f-4af7-8bf9-a9c6fb548f86 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.573690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4e219-db7f-4af7-8bf9-a9c6fb548f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.606403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:59.608975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:59.627151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-14a4e219-db7f-4af7-8bf9-a9c6fb548f86 None None] MFA Rules not processed for user `b5a5a5beeaa3414d916fe8ba32489855`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:12:59.628407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-14a4e219-db7f-4af7-8bf9-a9c6fb548f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:12:59.629195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 816/1618] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:12:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:12:59.630541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:59.648657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0dab-ed84-4639-9610-64e10bf0db17 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:59.660075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:59.663458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.663741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.664019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.665417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:59.668056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:59.713926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 817/1619] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:59 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:59.713926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:59.737396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 803/1620] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:12:59.737880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4e219-db7f-4af7-8bf9-a9c6fb548f86 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:59.768430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a4e219-db7f-4af7-8bf9-a9c6fb548f86 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:59.799304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:59.828323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd2de5-72e3-4c56-a4e5-9cf844d48405 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:59.836592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:59.838296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.839589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.840055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.842935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:59.846752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:12:59.886506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 818/1621] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:12:59 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:12:59.887570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:12:59.908044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:12:59.930053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c684-3d6b-455a-b9d8-0cee8d6aac76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:59.931333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c684-3d6b-455a-b9d8-0cee8d6aac76 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.931800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c684-3d6b-455a-b9d8-0cee8d6aac76 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.932172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c684-3d6b-455a-b9d8-0cee8d6aac76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.982800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213cffa-0f4a-49ec-9506-c7d6840c360c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:12:59.989590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:12:59.990460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:12:59.990749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:12:59.991087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:12:59.991842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:12:59.994757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.024713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 819/1622] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:12:59 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:00.025954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.038104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555349c-5a7a-4770-826b-fe416e531fe2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.045773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45983b4-7d07-4c75-94d3-b09a16f05f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.047409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45983b4-7d07-4c75-94d3-b09a16f05f20 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.047886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45983b4-7d07-4c75-94d3-b09a16f05f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.048409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45983b4-7d07-4c75-94d3-b09a16f05f20 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.049989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45983b4-7d07-4c75-94d3-b09a16f05f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.052378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45983b4-7d07-4c75-94d3-b09a16f05f20 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.060350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c684-3d6b-455a-b9d8-0cee8d6aac76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.062257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c684-3d6b-455a-b9d8-0cee8d6aac76 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.077194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 804/1623] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:12:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:00.079892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b29a3-800f-432d-bf56-59cf3ff74951 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.081192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b29a3-800f-432d-bf56-59cf3ff74951 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.081496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b29a3-800f-432d-bf56-59cf3ff74951 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.090209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 805/1624] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 20:13:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:00.091450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b29a3-800f-432d-bf56-59cf3ff74951 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.105456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 820/1625] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:00 2022] POST /identity/v3/users => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:00.113373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6631d2-6415-4518-9385-df5b1578f986 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.113610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6631d2-6415-4518-9385-df5b1578f986 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.113892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6631d2-6415-4518-9385-df5b1578f986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.114204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b29a3-800f-432d-bf56-59cf3ff74951 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.121451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.122454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.123688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.124213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.126286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.127210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.144613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 806/1626] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:00.145915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.158248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5a8bd-bfb4-4e39-a7f6-a52d7f415f29 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.162197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-fa6631d2-6415-4518-9385-df5b1578f986 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:00.163580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.164337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.164695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.165047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.165998 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.167130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fa6631d2-6415-4518-9385-df5b1578f986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:00.167966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.184720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 807/1627] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:00.186553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.200579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365034cb-1fd5-40df-b26a-83e30f20692f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.206427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.207572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.207963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.208467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] PATH_INFO: `/v3/projects/51fd2a2fc4204b1092b2bde653e7d766/users/4ddeac272d534cb9b692d48195a478ad/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.228616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fd2a2fc4204b1092b2bde653e7d766, user_id=4ddeac272d534cb9b692d48195a478ad, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.233147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.257960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 808/1628] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:00 2022] PUT /identity/v3/projects/51fd2a2fc4204b1092b2bde653e7d766/users/4ddeac272d534cb9b692d48195a478ad/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:00.260252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.350778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 821/1629] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:13:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:00.353373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6631d2-6415-4518-9385-df5b1578f986 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.379044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6631d2-6415-4518-9385-df5b1578f986 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.431621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af24d8e-a026-4a34-be1e-6626bf875aff admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.444208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.446573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.446907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.448891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] PATH_INFO: `/v3/projects/29855b6029c14200a7ac6e580b602a47/users/02316958af3e4cfbabda52c533e20332/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.467795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:00.487793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29855b6029c14200a7ac6e580b602a47, user_id=02316958af3e4cfbabda52c533e20332, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.499218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.525705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 809/1630] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:00 2022] PUT /identity/v3/projects/29855b6029c14200a7ac6e580b602a47/users/02316958af3e4cfbabda52c533e20332/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:00.529607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.530744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.531662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.533841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.535166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.536220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.545182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.582675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 822/1631] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:00.582675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.607114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2512c-9447-47d3-9774-82ffaf95b157 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.626210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:00.684558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf175f7-bc91-4824-880a-f315d5e93d38 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.693720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.694753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.696020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.696628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.761449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.762176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.762460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.762735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.763510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.765131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.797095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 823/1632] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:00.800876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.836129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.837741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.852735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 810/1633] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:00.854003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.867373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f01fde-b2b6-480f-8caf-93121382f8cb service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.872930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:00.873926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:00.874278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:00.874760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] PATH_INFO: `/v3/projects/51fd2a2fc4204b1092b2bde653e7d766/users/4ddeac272d534cb9b692d48195a478ad/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:00.876955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fd2a2fc4204b1092b2bde653e7d766, user_id=4ddeac272d534cb9b692d48195a478ad, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:00.879795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:00.894033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 811/1634] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:00 2022] PUT /identity/v3/projects/51fd2a2fc4204b1092b2bde653e7d766/users/4ddeac272d534cb9b692d48195a478ad/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:00.899200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:00.948232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380864e1-478d-4e4c-abf4-4e2fce60929a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:00.987180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b3fed-0c02-4bb1-8227-771b0d8ac3d7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:01.000791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d58e7-dbde-4050-9513-0248fa97a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:01.001911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d58e7-dbde-4050-9513-0248fa97a2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.002325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d58e7-dbde-4050-9513-0248fa97a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.002782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d58e7-dbde-4050-9513-0248fa97a2f6 admin admin] PATH_INFO: `/v3/projects/29855b6029c14200a7ac6e580b602a47/users/02316958af3e4cfbabda52c533e20332/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.009044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d58e7-dbde-4050-9513-0248fa97a2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29855b6029c14200a7ac6e580b602a47, user_id=02316958af3e4cfbabda52c533e20332, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:01.022349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d58e7-dbde-4050-9513-0248fa97a2f6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:01.058036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 812/1635] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:00 2022] PUT /identity/v3/projects/29855b6029c14200a7ac6e580b602a47/users/02316958af3e4cfbabda52c533e20332/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:01.059948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b99f-9db0-4095-a411-9ca1ed40c872 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.061034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b99f-9db0-4095-a411-9ca1ed40c872 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.061455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b99f-9db0-4095-a411-9ca1ed40c872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.111439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed67a0-d0af-44cc-af74-76403d77937d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:01.114734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed67a0-d0af-44cc-af74-76403d77937d service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.115829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed67a0-d0af-44cc-af74-76403d77937d service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.116263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed67a0-d0af-44cc-af74-76403d77937d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.125051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d552b99f-9db0-4095-a411-9ca1ed40c872 None None] MFA Rules not processed for user `4ddeac272d534cb9b692d48195a478ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:01.127685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:01.128403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d552b99f-9db0-4095-a411-9ca1ed40c872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:01.276604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:01.290255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed67a0-d0af-44cc-af74-76403d77937d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:01.295022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed67a0-d0af-44cc-af74-76403d77937d service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:01.314992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 824/1636] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:01.316519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35938cc-428a-4f50-8132-071f8b457701 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.320127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35938cc-428a-4f50-8132-071f8b457701 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.320512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35938cc-428a-4f50-8132-071f8b457701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.335537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 813/1637] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:01.348111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552b99f-9db0-4095-a411-9ca1ed40c872 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:01.383205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e35938cc-428a-4f50-8132-071f8b457701 None None] MFA Rules not processed for user `02316958af3e4cfbabda52c533e20332`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:01.384591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e35938cc-428a-4f50-8132-071f8b457701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:01.464964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552b99f-9db0-4095-a411-9ca1ed40c872 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:01.472593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d371ac-8cec-4e55-86ba-46e14f79aea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:01.473327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d371ac-8cec-4e55-86ba-46e14f79aea2 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.473721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d371ac-8cec-4e55-86ba-46e14f79aea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.475319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d371ac-8cec-4e55-86ba-46e14f79aea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.506286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d371ac-8cec-4e55-86ba-46e14f79aea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:01.509095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d371ac-8cec-4e55-86ba-46e14f79aea2 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:01.550924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 814/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:01 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:01.553114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3a7c-1e72-4dde-9ea3-1cbc4088d3a6 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.559075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3a7c-1e72-4dde-9ea3-1cbc4088d3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.560485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b3a7c-1e72-4dde-9ea3-1cbc4088d3a6 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.561993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 825/1639] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:01.563178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 815/1640] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 20:13:01 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:01.569402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47fb8-6efa-44a0-a1a7-8a443a0eab77 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.569821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47fb8-6efa-44a0-a1a7-8a443a0eab77 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.570680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a47fb8-6efa-44a0-a1a7-8a443a0eab77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.604842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a3a47fb8-6efa-44a0-a1a7-8a443a0eab77 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:01.606264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a3a47fb8-6efa-44a0-a1a7-8a443a0eab77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:01.639949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b3a7c-1e72-4dde-9ea3-1cbc4088d3a6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:01.657562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b3a7c-1e72-4dde-9ea3-1cbc4088d3a6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:01.678551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:01.681344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.682092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.683152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:01.710596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:01.713890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:01.756867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 816/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:01 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:01.809629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 826/1642] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:01.970638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:01.982731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5c4ec-5a3f-4bd5-af22-59bea898f10a service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:01.988083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32662629-dc99-4144-bb77-60d6055002b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:01.989063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32662629-dc99-4144-bb77-60d6055002b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:01.989553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32662629-dc99-4144-bb77-60d6055002b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:01.990031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32662629-dc99-4144-bb77-60d6055002b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:02.029091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32662629-dc99-4144-bb77-60d6055002b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:02.033817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32662629-dc99-4144-bb77-60d6055002b1 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:02.069831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 817/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:02.091644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318879a9-b5ba-40ac-ba79-3ae540a0d668 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:02.092041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318879a9-b5ba-40ac-ba79-3ae540a0d668 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:02.092421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318879a9-b5ba-40ac-ba79-3ae540a0d668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:02.156183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-318879a9-b5ba-40ac-ba79-3ae540a0d668 None None] MFA Rules not processed for user `9b03f848bf5d43c8be9d2a9bff06dcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:02.157427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-318879a9-b5ba-40ac-ba79-3ae540a0d668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:02.183488 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:02.329323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 827/1644] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:02.330870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294111a-6055-435c-b10c-77a7134c82ef None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:02.331426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294111a-6055-435c-b10c-77a7134c82ef None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:02.331426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294111a-6055-435c-b10c-77a7134c82ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:02.379566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b294111a-6055-435c-b10c-77a7134c82ef None None] MFA Rules not processed for user `9b03f848bf5d43c8be9d2a9bff06dcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:02.380873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b294111a-6055-435c-b10c-77a7134c82ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:02.402417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 818/1645] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:02.450403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318879a9-b5ba-40ac-ba79-3ae540a0d668 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:02.460241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294111a-6055-435c-b10c-77a7134c82ef None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:02.466282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318879a9-b5ba-40ac-ba79-3ae540a0d668 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:02.478443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b294111a-6055-435c-b10c-77a7134c82ef None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:02.480557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb486d65-b624-4d7f-8412-2b4fef77b528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:02.481245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486d65-b624-4d7f-8412-2b4fef77b528 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:02.481514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486d65-b624-4d7f-8412-2b4fef77b528 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:02.481785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486d65-b624-4d7f-8412-2b4fef77b528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:02.488262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:02.490479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:02.491337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:02.492123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:02.507062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:02.510808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:02.557656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 819/1646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:02.652381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb486d65-b624-4d7f-8412-2b4fef77b528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:02.658368 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb486d65-b624-4d7f-8412-2b4fef77b528 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:02.678683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 828/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:02 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:03.609874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:03.727928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6450c-d897-40c8-9277-a2a1014dbed8 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:03.728409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6450c-d897-40c8-9277-a2a1014dbed8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:03.728489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6450c-d897-40c8-9277-a2a1014dbed8 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:03.730687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 829/1648] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 20:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:13:03.736363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:03.736590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:03.737097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:03.767245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e60c4-9ea5-4ec9-9a72-d204fafbd3d3 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:03.774279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:03.775540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:03.775919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:03.777255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] PATH_INFO: `/v3/users/bf32414823884e92b355e29ab7d4d005` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:03.777848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf32414823884e92b355e29ab7d4d005)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:03.780326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:03.859869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] MFA Rules not processed for user `8751982010ae4b7eb6c855aea7540a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:03.861187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:03.862950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:03.875074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf32414823884e92b355e29ab7d4d005'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:03.875610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf32414823884e92b355e29ab7d4d005'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:03.876266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf32414823884e92b355e29ab7d4d005'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:03.900627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf32414823884e92b355e29ab7d4d005'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:03.921122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1a45ee27-ae1c-47ea-8282-ddf9206dfde7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf32414823884e92b355e29ab7d4d005'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:03.962787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 820/1649] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:03 2022] DELETE /identity/v3/users/bf32414823884e92b355e29ab7d4d005 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:03.969565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:03.969771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:03.970152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:04.028703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:04.030318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:04.030527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 830/1650] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:13:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:04.131966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:04.135496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:04.166688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88fd09-a4fc-4e2b-afad-634c5c801e12 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:04.233314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 821/1651] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:04.236388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:04.242162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:04.272895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05b3d4-4769-4dbb-a989-7c157ad7e807 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:04.286229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:04.287735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:04.288736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:04.289026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] PATH_INFO: `/v3/users/a230f046950d49109c1f6b9970384eec` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:04.291212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a230f046950d49109c1f6b9970384eec)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:04.293767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:04.306661 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:04.325918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:04.326582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:04.329895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:04.329895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:04.365696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:04.368116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:04.405546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 831/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:04.406658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:04.434096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf78a2-4099-499a-8bb3-4c6d62c38478 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:04.463954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79fddd-57b5-4a90-b97f-914da8d15380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:04.468321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79fddd-57b5-4a90-b97f-914da8d15380 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:04.470090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79fddd-57b5-4a90-b97f-914da8d15380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:04.471064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79fddd-57b5-4a90-b97f-914da8d15380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:04.513822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a230f046950d49109c1f6b9970384eec'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:04.515127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a230f046950d49109c1f6b9970384eec'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:04.519266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a230f046950d49109c1f6b9970384eec'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:04.523761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79fddd-57b5-4a90-b97f-914da8d15380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:04.525216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d79fddd-57b5-4a90-b97f-914da8d15380 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:04.534592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a230f046950d49109c1f6b9970384eec'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:04.567440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 832/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:04.591883 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a230f046950d49109c1f6b9970384eec'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:04.640464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 822/1654] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:04 2022] DELETE /identity/v3/users/a230f046950d49109c1f6b9970384eec => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:04.645021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:04.645534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:04.645892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:04.701267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:04.703706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:04.869418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 833/1655] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:04.914708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:04.915492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:04.994502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:05.055687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe71ea-37d7-4636-a16f-7c17347de924 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:05.068931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0056b-1987-4c6a-bada-7dafbb3ae2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:05.070213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0056b-1987-4c6a-bada-7dafbb3ae2ee service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:05.070927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0056b-1987-4c6a-bada-7dafbb3ae2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:05.071417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0056b-1987-4c6a-bada-7dafbb3ae2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:05.111178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0056b-1987-4c6a-bada-7dafbb3ae2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:05.116010 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0056b-1987-4c6a-bada-7dafbb3ae2ee service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:05.157711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 823/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:05.282702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:05.282702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:05.314640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864d0353-0459-47fc-b4ba-a173476d2fad None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:05.331642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:05.332698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:05.332991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:05.333269 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] PATH_INFO: `/v3/users/60112f9283334d30be3c64eb6406200a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:05.339830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60112f9283334d30be3c64eb6406200a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:05.345929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: WARNING py.warnings [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:13:05.345929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: warnings.warn(msg) May 26 20:13:05.345929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: May 26 20:13:05.350985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:05.529295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60112f9283334d30be3c64eb6406200a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:05.550909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60112f9283334d30be3c64eb6406200a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:05.553294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60112f9283334d30be3c64eb6406200a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:05.608659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60112f9283334d30be3c64eb6406200a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:05.610190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60112f9283334d30be3c64eb6406200a'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:05.641856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 834/1657] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:05 2022] DELETE /identity/v3/users/60112f9283334d30be3c64eb6406200a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:05.647201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae7a10-45a8-4fee-a1a0-9d3491726d47 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:05.648299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae7a10-45a8-4fee-a1a0-9d3491726d47 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:05.648790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae7a10-45a8-4fee-a1a0-9d3491726d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:05.686386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f9ae7a10-45a8-4fee-a1a0-9d3491726d47 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:05.689325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f9ae7a10-45a8-4fee-a1a0-9d3491726d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:05.808053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 824/1658] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:05.824400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:05.827791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:05.928476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:05.934592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cd9db-ea5f-4f5c-9f11-49145e0647a4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:05.942372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d6573-7d3f-4952-99ac-65761884abfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:05.944140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6573-7d3f-4952-99ac-65761884abfb service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:05.944435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6573-7d3f-4952-99ac-65761884abfb service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:05.944767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d6573-7d3f-4952-99ac-65761884abfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:05.960099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d6573-7d3f-4952-99ac-65761884abfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:05.962005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d6573-7d3f-4952-99ac-65761884abfb service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:05.975368 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 835/1659] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:06.629039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca0ab-5602-44d2-9e62-de5d78a38ba2 None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:06.629345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca0ab-5602-44d2-9e62-de5d78a38ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:06.629638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca0ab-5602-44d2-9e62-de5d78a38ba2 None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:06.631869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 825/1660] 10.222.0.48 () {54 vars in 960 bytes} [Thu May 26 20:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:06.646670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:06.647156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:06.647582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:06.680567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:06.682162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:06.878001 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e462c2-88ed-4d1e-8305-68237e2c9edb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:06.878515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e462c2-88ed-4d1e-8305-68237e2c9edb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:06.878583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e462c2-88ed-4d1e-8305-68237e2c9edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:06.930643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 836/1661] 10.222.0.48 () {58 vars in 1057 bytes} [Thu May 26 20:13:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:06.932461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:06.941182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:06.952442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e6e462c2-88ed-4d1e-8305-68237e2c9edb None None] MFA Rules not processed for user `8e15218966314337ae4d70e374bd4bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:06.956573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e6e462c2-88ed-4d1e-8305-68237e2c9edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:06.970899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48052cac-f406-48eb-a27d-70962eedf3a2 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:06.987037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:06.987989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:06.988229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:06.988480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] PATH_INFO: `/v3/users/ce37b3dcbd9e4c089e848c833fedf0b3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:06.990400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce37b3dcbd9e4c089e848c833fedf0b3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:06.992403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:07.094605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce37b3dcbd9e4c089e848c833fedf0b3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.119814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce37b3dcbd9e4c089e848c833fedf0b3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.120587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce37b3dcbd9e4c089e848c833fedf0b3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.152621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce37b3dcbd9e4c089e848c833fedf0b3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.153830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce37b3dcbd9e4c089e848c833fedf0b3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.167080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 826/1662] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:07.167080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e462c2-88ed-4d1e-8305-68237e2c9edb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:07.182507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 837/1663] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:06 2022] DELETE /identity/v3/users/ce37b3dcbd9e4c089e848c833fedf0b3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:07.183738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:07.187333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e462c2-88ed-4d1e-8305-68237e2c9edb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:07.188664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:07.307124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:07.310497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e404d01-43e7-4bc1-a710-b530d6e366ca admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:07.318957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:07.320122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:07.320440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:07.320686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] PATH_INFO: `/v3/projects/05170ebf4ce940fbb8f8d5396ab2fa68` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:07.323141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05170ebf4ce940fbb8f8d5396ab2fa68)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:07.326589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:07.327101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:07.328856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:07.330781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:07.331473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:07.331891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:07.334765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:07.354995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:07.357631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:07.379044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 827/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:07.381733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:07.384588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:07.408877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05170ebf4ce940fbb8f8d5396ab2fa68', 'request_id': 'req-15fa7588-b4bb-4016-a24a-c3cd548e2667'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.417917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05170ebf4ce940fbb8f8d5396ab2fa68', 'request_id': 'req-15fa7588-b4bb-4016-a24a-c3cd548e2667'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.422715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee6a19-9cc9-4b95-a99b-2996b48aa513 service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:07.438389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05170ebf4ce940fbb8f8d5396ab2fa68', 'request_id': 'req-15fa7588-b4bb-4016-a24a-c3cd548e2667'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.477114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] The token cache is being invalidate because project 05170ebf4ce940fbb8f8d5396ab2fa68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:07.478772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.491444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.493856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 838/1665] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:07 2022] DELETE /identity/v3/projects/05170ebf4ce940fbb8f8d5396ab2fa68 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:07.496529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:07.498130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:07.587056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:07.587951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:07.588238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:07.588516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] PATH_INFO: `/v3/projects/cd0f198bae8f4cb684f6451ceaec00f9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:07.600083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0f198bae8f4cb684f6451ceaec00f9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:07.600969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: WARNING py.warnings [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 20:13:07.600969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: warnings.warn(msg) May 26 20:13:07.600969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: May 26 20:13:07.602194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:07.715505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fa7588-b4bb-4016-a24a-c3cd548e2667 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:07.739535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0f198bae8f4cb684f6451ceaec00f9', 'request_id': 'req-c9d6333d-3ec4-49ec-8054-c2f2d632669e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.757708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0f198bae8f4cb684f6451ceaec00f9', 'request_id': 'req-c9d6333d-3ec4-49ec-8054-c2f2d632669e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.769232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0f198bae8f4cb684f6451ceaec00f9', 'request_id': 'req-c9d6333d-3ec4-49ec-8054-c2f2d632669e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.812970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] The token cache is being invalidate because project cd0f198bae8f4cb684f6451ceaec00f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:07.813277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.819242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.821619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 828/1666] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:07 2022] DELETE /identity/v3/projects/cd0f198bae8f4cb684f6451ceaec00f9 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:07.825782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:07.827543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:07.827956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:07.828846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:07.829127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:07.832827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] PATH_INFO: `/v3/projects/a04f1f262059447eb15c1dc7bba27ad3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:07.835034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04f1f262059447eb15c1dc7bba27ad3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:07.840742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:07.941555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:07.961228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04f1f262059447eb15c1dc7bba27ad3', 'request_id': 'req-057c3899-d214-4ec9-95ac-d4bcb25e6b87'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.976877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04f1f262059447eb15c1dc7bba27ad3', 'request_id': 'req-057c3899-d214-4ec9-95ac-d4bcb25e6b87'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:07.993527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04f1f262059447eb15c1dc7bba27ad3', 'request_id': 'req-057c3899-d214-4ec9-95ac-d4bcb25e6b87'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.023711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] The token cache is being invalidate because project a04f1f262059447eb15c1dc7bba27ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:08.024471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.025441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-057c3899-d214-4ec9-95ac-d4bcb25e6b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.028331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 839/1667] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:07 2022] DELETE /identity/v3/projects/a04f1f262059447eb15c1dc7bba27ad3 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:08.030264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dc869-6097-4ca0-9fd1-e64640041aa3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.030825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dc869-6097-4ca0-9fd1-e64640041aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.031377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dc869-6097-4ca0-9fd1-e64640041aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.039626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6333d-3ec4-49ec-8054-c2f2d632669e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:08.060132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a28dc869-6097-4ca0-9fd1-e64640041aa3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:08.062254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a28dc869-6097-4ca0-9fd1-e64640041aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.072896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:08.148784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 840/1668] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:08.156404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5af7ba-191e-41cf-8aa2-0cf0deb251a0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.159090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5af7ba-191e-41cf-8aa2-0cf0deb251a0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.159536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5af7ba-191e-41cf-8aa2-0cf0deb251a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.203172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1f5af7ba-191e-41cf-8aa2-0cf0deb251a0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:08.203914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:08.204487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1f5af7ba-191e-41cf-8aa2-0cf0deb251a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.205000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.205466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.205957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.211510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.223721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 841/1669] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:08.225489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.225781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.226065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.269077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:08.270319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.292574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 842/1670] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:08.292574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:08.300016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.321499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd8956-6224-4256-ba06-f86d7cddbe2f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:08.336535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:08.337437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.337726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.338011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] PATH_INFO: `/v3/users/4ddeac272d534cb9b692d48195a478ad` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.339297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddeac272d534cb9b692d48195a478ad)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:08.341273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:08.362423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:08.365940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:08.409426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 829/1671] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:08.414107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:08.421414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.444763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddeac272d534cb9b692d48195a478ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.468809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddeac272d534cb9b692d48195a478ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.469536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddeac272d534cb9b692d48195a478ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.517866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddeac272d534cb9b692d48195a478ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.523467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-00465f4f-e0f4-4375-80c1-4542aa85c731 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddeac272d534cb9b692d48195a478ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:08.571018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 843/1672] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:08 2022] DELETE /identity/v3/users/4ddeac272d534cb9b692d48195a478ad => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:08.572658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08560-7f9e-43bb-8821-f8144f7f5ec8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.572955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08560-7f9e-43bb-8821-f8144f7f5ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.573233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08560-7f9e-43bb-8821-f8144f7f5ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.591627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925a9c8-933a-4ac5-8a58-c64062957e67 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:08.640505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-28c08560-7f9e-43bb-8821-f8144f7f5ec8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:08.641549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-28c08560-7f9e-43bb-8821-f8144f7f5ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.750232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:08.795778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:08.796459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.796752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.797027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.817974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:08.905808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 844/1673] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:08.914688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:08.919983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b1cc-3f7f-4db4-89bc-a9ad7ceb686c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:08.920643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b1cc-3f7f-4db4-89bc-a9ad7ceb686c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:08.921251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b1cc-3f7f-4db4-89bc-a9ad7ceb686c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:08.979758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-71a4b1cc-3f7f-4db4-89bc-a9ad7ceb686c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:08.983749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-71a4b1cc-3f7f-4db4-89bc-a9ad7ceb686c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:09.018628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 845/1674] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:09.019828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4b1cc-3f7f-4db4-89bc-a9ad7ceb686c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.045516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4b1cc-3f7f-4db4-89bc-a9ad7ceb686c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.056129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.058794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.062497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.063681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.072243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.072872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.073928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:09.079357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.083973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.097057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 830/1675] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:09.097943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.125378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c8784-82f4-4590-ab85-eed10eedfbd6 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.144400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.145115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.145410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.145697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.147104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:09.147607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.149254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.174701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 846/1676] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:09.176008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.183739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 831/1677] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:09.184800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.204385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abaf97-f45b-45b9-ba37-f8843371f942 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.209558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c34c9-4989-42e3-8a08-69d981cd5d2e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.226877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.227369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.227577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.227870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.228053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.228158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.228348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.228629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.228842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.229333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.232052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.237439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.351130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 847/1678] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:09 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:09.354788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.355332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 832/1679] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:09.359689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.585293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b869fe-0c22-452a-a288-96be174019c3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.598283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.599325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c626ed-990c-465d-b6dd-7f143a5817c7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.602055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.602368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.602652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.603408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.605394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.618102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.619489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.619804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.620107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.621102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.623308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.687064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 848/1680] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:09 2022] POST /identity/v3/users => generated 282 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:09.691558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.705903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 833/1681] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:09 2022] POST /identity/v3/users => generated 287 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:09.708968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.729340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f769f6bb-9976-438a-8fde-7bd78c9d7ef7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.756855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de0b47-7926-4e81-92a6-1cce65bec6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.757520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c7501-56ff-498a-9267-2848009df575 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.757632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de0b47-7926-4e81-92a6-1cce65bec6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.757985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de0b47-7926-4e81-92a6-1cce65bec6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.758316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de0b47-7926-4e81-92a6-1cce65bec6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.759214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de0b47-7926-4e81-92a6-1cce65bec6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.765118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de0b47-7926-4e81-92a6-1cce65bec6fe admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.784098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.784705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.784995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.785283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.786033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.789275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.797612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 849/1682] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:09.799048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf07c-cc02-49c5-bd94-88a39af0e2c4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.804959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf07c-cc02-49c5-bd94-88a39af0e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.805258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadf07c-cc02-49c5-bd94-88a39af0e2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.816648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 834/1683] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:09.817599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.851252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08786694-3f88-4754-9a44-4374f849005f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:09.873665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:09.874632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:09.878236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:09.878695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:09.879797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:09.881623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:09.894468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7cadf07c-cc02-49c5-bd94-88a39af0e2c4 None None] MFA Rules not processed for user `13a00d0c317a4e69aa84b3851d5f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:09.895726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7cadf07c-cc02-49c5-bd94-88a39af0e2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:09.934208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 835/1684] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:09.935532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:09.945488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:09.981342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f449e6-4667-4c51-87fc-5daeab85d972 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:10.007670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:10.008641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.008876 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.009152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] PATH_INFO: `/v3/users/b5a5a5beeaa3414d916fe8ba32489855` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.015575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a5a5beeaa3414d916fe8ba32489855)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:10.018595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:10.037726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:10.077745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 850/1685] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:10.079025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf07c-cc02-49c5-bd94-88a39af0e2c4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:10.097972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadf07c-cc02-49c5-bd94-88a39af0e2c4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:10.105649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:10.106574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.106938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.107321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.108208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:10.110792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:10.127582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 851/1686] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:10.131973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:10.133799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a5a5beeaa3414d916fe8ba32489855'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.135603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a5a5beeaa3414d916fe8ba32489855'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.146803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a749b0-5eae-41ee-aadd-bdf0d1050430 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:10.150978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a5a5beeaa3414d916fe8ba32489855'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.153384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8fd24e-1039-416b-9cf8-750ef5228863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:10.155325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd24e-1039-416b-9cf8-750ef5228863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.155793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd24e-1039-416b-9cf8-750ef5228863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.156217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8fd24e-1039-416b-9cf8-750ef5228863 admin admin] PATH_INFO: `/v3/projects/378db201417147aebcfd4539fa9ca64f/users/73f8611f29bd43bb9eb37c8435d82876/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.156618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:10.174695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a5a5beeaa3414d916fe8ba32489855'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.194321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd24e-1039-416b-9cf8-750ef5228863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378db201417147aebcfd4539fa9ca64f, user_id=73f8611f29bd43bb9eb37c8435d82876, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:10.198170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8fd24e-1039-416b-9cf8-750ef5228863 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:10.212627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a5a5beeaa3414d916fe8ba32489855'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.248228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 836/1688] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:09 2022] DELETE /identity/v3/users/b5a5a5beeaa3414d916fe8ba32489855 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:10.252094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:10.254171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 852/1688] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:10 2022] PUT /identity/v3/projects/378db201417147aebcfd4539fa9ca64f/users/73f8611f29bd43bb9eb37c8435d82876/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:10.257901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:10.261290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.261522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.261806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.314166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] MFA Rules not processed for user `13a00d0c317a4e69aa84b3851d5f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:10.315454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:10.465864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e2490-f35f-4d6e-90b4-560fcb2212db admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:10.479132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:10.480041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.480329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.480611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] PATH_INFO: `/v3/projects/51fd2a2fc4204b1092b2bde653e7d766` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.483624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=51fd2a2fc4204b1092b2bde653e7d766)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:10.485920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:10.533581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 853/1689] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:10.539093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:10.544295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:10.605483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fbf23-7190-4349-bf2b-0a0a5fa3e425 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:10.618535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51fd2a2fc4204b1092b2bde653e7d766', 'request_id': 'req-db616c9a-8f7b-48cd-acf9-28607f081ebf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.668869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51fd2a2fc4204b1092b2bde653e7d766', 'request_id': 'req-db616c9a-8f7b-48cd-acf9-28607f081ebf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.724431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51fd2a2fc4204b1092b2bde653e7d766', 'request_id': 'req-db616c9a-8f7b-48cd-acf9-28607f081ebf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.756297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] The token cache is being invalidate because project 51fd2a2fc4204b1092b2bde653e7d766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:10.756696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.759078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-db616c9a-8f7b-48cd-acf9-28607f081ebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:10.762896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 837/1690] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:10 2022] DELETE /identity/v3/projects/51fd2a2fc4204b1092b2bde653e7d766 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:10.769130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01029f-e4c7-4ca3-be77-114bc718d25e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.769775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01029f-e4c7-4ca3-be77-114bc718d25e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.770515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01029f-e4c7-4ca3-be77-114bc718d25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.819829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:10.820915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.821202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.823666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] PATH_INFO: `/v3/projects/7462092f3e864db0853ef9ee6d298a26/users/90b4be1570d14023bd0bc47547522707/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.852914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4c01029f-e4c7-4ca3-be77-114bc718d25e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:10.861187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4c01029f-e4c7-4ca3-be77-114bc718d25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:10.878306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7462092f3e864db0853ef9ee6d298a26, user_id=90b4be1570d14023bd0bc47547522707, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:10.885071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 838/1691] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:10.889837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:10.890073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:10.890183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:10.890410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:10.931370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 854/1692] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:10 2022] PUT /identity/v3/projects/7462092f3e864db0853ef9ee6d298a26/users/90b4be1570d14023bd0bc47547522707/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:10.943822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:10.950731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:10.984075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] MFA Rules not processed for user `73f8611f29bd43bb9eb37c8435d82876`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:10.988472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.093698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:11.108375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:11.143719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633313-12fe-4aa4-a5a0-34d371054cf9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:11.175207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:11.176119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:11.176403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:11.176678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] PATH_INFO: `/v3/projects/969fa6291d1d45158048697c88d047d9` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:11.182088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 839/1693] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:10 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:11.184238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:11.187114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.190764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=969fa6291d1d45158048697c88d047d9)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:11.193559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:11.357239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969fa6291d1d45158048697c88d047d9', 'request_id': 'req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:11.379011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969fa6291d1d45158048697c88d047d9', 'request_id': 'req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:11.387653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee423b9-b6ce-4d7b-a290-1e10015dd0ef None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:11.389284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969fa6291d1d45158048697c88d047d9', 'request_id': 'req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:11.421824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] The token cache is being invalidate because project 969fa6291d1d45158048697c88d047d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:11.422128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:11.422889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2a2560e8-3a82-4c6a-bd63-72bd10d0a94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:11.428037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 855/1694] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:10 2022] DELETE /identity/v3/projects/969fa6291d1d45158048697c88d047d9 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:11.428037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:11.428567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:11.428884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:11.461541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:11.464121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.543523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b6145-742b-4061-910d-5565c4513c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:11.544428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6145-742b-4061-910d-5565c4513c8d service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:11.544791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6145-742b-4061-910d-5565c4513c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:11.545326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b6145-742b-4061-910d-5565c4513c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:11.547643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d62b6145-742b-4061-910d-5565c4513c8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.611899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 856/1695] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:11.612955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:11.615557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.694140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b6145-742b-4061-910d-5565c4513c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:11.695850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b6145-742b-4061-910d-5565c4513c8d service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:11.706054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 840/1696] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:11.707558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:11.707854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:11.708130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:11.740290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840afaa-708f-4e23-bc93-f7e6ae6eb665 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:11.752390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:11.753292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:11.754130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:11.755022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:11.761963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.766086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] MFA Rules not processed for user `90b4be1570d14023bd0bc47547522707`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:11.767323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.778783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:11.779385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:11.782347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:11.825717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 857/1697] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:11.826601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:11.829416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.848745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfdf21-504f-4257-9607-963a2001011e service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:11.856120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18678897-c6af-4c78-af47-ff7d15a3fc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:11.856830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678897-c6af-4c78-af47-ff7d15a3fc72 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:11.857114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678897-c6af-4c78-af47-ff7d15a3fc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:11.857393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18678897-c6af-4c78-af47-ff7d15a3fc72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:11.858102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18678897-c6af-4c78-af47-ff7d15a3fc72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:11.861773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18678897-c6af-4c78-af47-ff7d15a3fc72 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:11.891892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:11.903084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 858/1698] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:11 2022] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:11.904968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ddbe5-99c8-4a2c-bc1b-f1128ad97dff None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:11.905585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ddbe5-99c8-4a2c-bc1b-f1128ad97dff None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:11.911817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ddbe5-99c8-4a2c-bc1b-f1128ad97dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:11.934415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-cb0ddbe5-99c8-4a2c-bc1b-f1128ad97dff None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:11.935408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 841/1699] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:11.936258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cb0ddbe5-99c8-4a2c-bc1b-f1128ad97dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.936403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:11.939767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:11.969264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49484c2f-5f78-409b-8b22-8d068998eaab None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.006774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 859/1700] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:13:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:12.008428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf236-8572-42e8-85dd-6ac9cd1fb70e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.008823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf236-8572-42e8-85dd-6ac9cd1fb70e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.009207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf236-8572-42e8-85dd-6ac9cd1fb70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.041791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-439cf236-8572-42e8-85dd-6ac9cd1fb70e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:12.043954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-439cf236-8572-42e8-85dd-6ac9cd1fb70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:12.049784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.050924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.051349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.051765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] PATH_INFO: `/v3/users/02316958af3e4cfbabda52c533e20332` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.061729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 860/1701] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:12.063088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf236-8572-42e8-85dd-6ac9cd1fb70e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.066305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02316958af3e4cfbabda52c533e20332)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.068529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.075054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf236-8572-42e8-85dd-6ac9cd1fb70e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.081347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.082257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.083124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.083124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.084230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.088818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.119924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 861/1702] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:12 2022] POST /identity/v3/users => generated 288 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:12.121751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.124372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:12.142871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02316958af3e4cfbabda52c533e20332'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:12.143083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b547d75-b7cd-4685-8d92-1b11fc6cf661 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.144591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02316958af3e4cfbabda52c533e20332'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:12.146596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02316958af3e4cfbabda52c533e20332'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:12.150010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.150426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.151416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.151898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.152746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.155142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.172924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02316958af3e4cfbabda52c533e20332'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:12.200822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 862/1703] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:12 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:12.201757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.206579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:12.208563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02316958af3e4cfbabda52c533e20332'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:12.256100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 842/1704] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:11 2022] DELETE /identity/v3/users/02316958af3e4cfbabda52c533e20332 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:12.256100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.257161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:12.298071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:12.301935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665b0ec-2d89-4160-bb6d-207cb0b65923 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.343877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d9ab7-18af-4350-a515-ec436823a9b8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.353571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.354276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.354564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.355087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.355905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.357520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.378536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 843/1705] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:12.378536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.385664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:12.400051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.403724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f09364-4ebc-4080-bc8d-846f009079e6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.406038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.406833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.407469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.408952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:12.409740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.410709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.411110 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.411949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.412263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.412944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.416166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.417198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.426852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:12.437856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 863/1706] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:12.438968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.442070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:12.459686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 844/1707] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:12 2022] POST /identity/v3/users => generated 293 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:12.461113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.475353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bd113-f5c2-432e-b34c-81984ef6c729 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.482117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.483299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.483667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.484039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] PATH_INFO: `/v3/projects/54eff06485dd4984b1b1bdce0eb58d10/users/83ce7d90b8a1453286a7c87e13745848/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.505469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54eff06485dd4984b1b1bdce0eb58d10, user_id=83ce7d90b8a1453286a7c87e13745848, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.510722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.539548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 845/1708] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:12 2022] PUT /identity/v3/projects/54eff06485dd4984b1b1bdce0eb58d10/users/83ce7d90b8a1453286a7c87e13745848/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:12.542313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:12.682730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a6057-56cc-4172-979b-b5a51c1cad10 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.775568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0430b8cb-61c3-4e56-8c25-5180d53532f8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:12.786061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.788695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.791590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.792349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.793320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:12.795901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:12.835168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:12.838901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:12.839402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:12.842149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:12.847331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:12.878344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 846/1709] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:12 2022] POST /identity/v3/projects => generated 357 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:12.883773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.046644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:13.051840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:13.093768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 864/1710] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:13:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:13:13.094667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.097746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452248e-2bc6-4a2d-bda6-1da94bd6ed55 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:13.115290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:13.117095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:13.118665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:13.118994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:13.121491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:13.125473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:13.126916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cab496d-9a0b-4ac4-8e59-8319c705c1b4 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:13.138255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:13.141348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:13.156223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 847/1711] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:13.158273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.160215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:13.164955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:13.165512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:13.168278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:13.177964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:13.200082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5849af-c06e-4152-93a6-756ca7d272e2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:13.212507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:13.214231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:13.217969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:13.218220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:13.219022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:13.227908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:13.228967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 865/1712] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:13.229854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.271776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa28995-bdc1-4427-b82e-4e34895a292b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:13.300255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:13.303907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:13.308162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:13.313896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] PATH_INFO: `/v3/projects/cec3347a9c344b8e951a06235e409651/users/dcd2ffcc344a4cebbc779c7d808f518c/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:13.327795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 848/1713] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:13 2022] POST /identity/v3/users => generated 279 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:13.333770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.337171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:13.382105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec3347a9c344b8e951a06235e409651, user_id=dcd2ffcc344a4cebbc779c7d808f518c, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:13.390017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dac3df-92ff-4a60-9d4c-6622214c2782 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:13.395563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:13.406359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:13.408304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:13.408606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:13.408895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] PATH_INFO: `/v3/projects/29855b6029c14200a7ac6e580b602a47` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:13.421392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29855b6029c14200a7ac6e580b602a47)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:13.428124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:13.434404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 866/1714] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:13 2022] PUT /identity/v3/projects/cec3347a9c344b8e951a06235e409651/users/dcd2ffcc344a4cebbc779c7d808f518c/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:13.435265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.480150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:13.679897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29855b6029c14200a7ac6e580b602a47', 'request_id': 'req-482682d7-525e-4964-bc9b-63f99cde69c7'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:13.686670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cb7f7-e140-4c97-9490-5d92143c59e6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:13.699754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29855b6029c14200a7ac6e580b602a47', 'request_id': 'req-482682d7-525e-4964-bc9b-63f99cde69c7'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:13.742423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29855b6029c14200a7ac6e580b602a47', 'request_id': 'req-482682d7-525e-4964-bc9b-63f99cde69c7'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:13.796510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] The token cache is being invalidate because project 29855b6029c14200a7ac6e580b602a47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:13.798628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:13.802758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:13.810004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:13.811850 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:13.811850 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:13.811850 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] PATH_INFO: `/v3/projects/54eff06485dd4984b1b1bdce0eb58d10/users/83ce7d90b8a1453286a7c87e13745848/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:13.813339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 849/1715] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:13 2022] DELETE /identity/v3/projects/29855b6029c14200a7ac6e580b602a47 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:13.814423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.820139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54eff06485dd4984b1b1bdce0eb58d10, user_id=83ce7d90b8a1453286a7c87e13745848, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:13.824441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:13.825696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:13.860089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 867/1716] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:13 2022] PUT /identity/v3/projects/54eff06485dd4984b1b1bdce0eb58d10/users/83ce7d90b8a1453286a7c87e13745848/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:13.861236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:13.862781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:13.871004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482682d7-525e-4964-bc9b-63f99cde69c7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:14.010709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084ef1-41e1-497b-baa2-f8b2259b0cd5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:14.022372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:14.023873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.024167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.024447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.025207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:14.027451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:14.044279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 868/1717] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:14.045290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:14.047435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:14.069580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9208837-752f-4f63-b97d-4d1e5cf5428e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:14.079984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:14.084460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.084854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.085182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] PATH_INFO: `/v3/projects/ce1f32bc98a7405fadb61c4a8e838f4a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.086994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1f32bc98a7405fadb61c4a8e838f4a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:14.089968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:14.107148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dc230-e0b3-49e4-bca9-3b85e5b29a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:14.108242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc230-e0b3-49e4-bca9-3b85e5b29a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.108801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc230-e0b3-49e4-bca9-3b85e5b29a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.109317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dc230-e0b3-49e4-bca9-3b85e5b29a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.110382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dc230-e0b3-49e4-bca9-3b85e5b29a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:14.112388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194dc230-e0b3-49e4-bca9-3b85e5b29a06 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:14.141431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 850/1718] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:14.145359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03ee9-f6b5-4e72-8390-40faeb6c06eb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.146612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03ee9-f6b5-4e72-8390-40faeb6c06eb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.147136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf03ee9-f6b5-4e72-8390-40faeb6c06eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.174497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-adf03ee9-f6b5-4e72-8390-40faeb6c06eb None None] MFA Rules not processed for user `8751982010ae4b7eb6c855aea7540a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:14.185463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-adf03ee9-f6b5-4e72-8390-40faeb6c06eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:14.195608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:14.215241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1f32bc98a7405fadb61c4a8e838f4a', 'request_id': 'req-bbd2aec1-a614-46c2-b3a8-d3c31277b416'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:14.225797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1f32bc98a7405fadb61c4a8e838f4a', 'request_id': 'req-bbd2aec1-a614-46c2-b3a8-d3c31277b416'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:14.241614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1f32bc98a7405fadb61c4a8e838f4a', 'request_id': 'req-bbd2aec1-a614-46c2-b3a8-d3c31277b416'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:14.263191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] The token cache is being invalidate because project ce1f32bc98a7405fadb61c4a8e838f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:14.263853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:14.264832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbd2aec1-a614-46c2-b3a8-d3c31277b416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:14.266826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 869/1719] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:14 2022] DELETE /identity/v3/projects/ce1f32bc98a7405fadb61c4a8e838f4a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:14.268937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9981aa-43fd-4561-b21c-9b887511da71 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.269264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9981aa-43fd-4561-b21c-9b887511da71 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.269573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9981aa-43fd-4561-b21c-9b887511da71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.326556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bb9981aa-43fd-4561-b21c-9b887511da71 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:14.332666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bb9981aa-43fd-4561-b21c-9b887511da71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:14.351228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 851/1720] 10.222.0.15 () {58 vars in 1015 bytes} [Thu May 26 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:14.353449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375463c-c688-4476-8d39-7d36889d88eb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.353984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375463c-c688-4476-8d39-7d36889d88eb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.354110 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375463c-c688-4476-8d39-7d36889d88eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.425870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:14.469788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7375463c-c688-4476-8d39-7d36889d88eb None None] MFA Rules not processed for user `83ce7d90b8a1453286a7c87e13745848`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:14.471627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7375463c-c688-4476-8d39-7d36889d88eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:14.529462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 870/1721] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:14.531445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.532077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.532546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.564433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] MFA Rules not processed for user `13a00d0c317a4e69aa84b3851d5f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:14.572618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:14.695205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 852/1722] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:14.697321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e9d4-b3a0-4744-8af0-8d7206184f7a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.697763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e9d4-b3a0-4744-8af0-8d7206184f7a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.698254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074e9d4-b3a0-4744-8af0-8d7206184f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.748365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 871/1723] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:14.750089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:14.752468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:14.773425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c54aa-274c-41b2-9536-70c46a5d8f9b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:14.774752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6074e9d4-b3a0-4744-8af0-8d7206184f7a None None] MFA Rules not processed for user `8e15218966314337ae4d70e374bd4bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:14.780070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6074e9d4-b3a0-4744-8af0-8d7206184f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:14.781428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:14.782850 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:14.783156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:14.783603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] PATH_INFO: `/v3/projects/cec3347a9c344b8e951a06235e409651/users/dcd2ffcc344a4cebbc779c7d808f518c/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:14.786112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cec3347a9c344b8e951a06235e409651, user_id=dcd2ffcc344a4cebbc779c7d808f518c, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:14.791122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:14.816552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 872/1724] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:14 2022] PUT /identity/v3/projects/cec3347a9c344b8e951a06235e409651/users/dcd2ffcc344a4cebbc779c7d808f518c/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:14.850295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:14.858669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.089524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abb994-3624-4615-9834-aaa4dd25681b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:15.102658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b54d91-b93f-4f69-aa02-2e503b5bb3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:15.103400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54d91-b93f-4f69-aa02-2e503b5bb3cf admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.103686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54d91-b93f-4f69-aa02-2e503b5bb3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.104021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b54d91-b93f-4f69-aa02-2e503b5bb3cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.104763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b54d91-b93f-4f69-aa02-2e503b5bb3cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:15.108204 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b54d91-b93f-4f69-aa02-2e503b5bb3cf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:15.111098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:15.136242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 873/1725] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:15.137800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.138091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.138371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.183569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:15.185297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.204376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 874/1726] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:15.205224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:15.206672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.283535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9c85b-626c-46ca-80c3-00a9e6b36b95 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:15.292621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8f937-949f-4e01-8559-3fe8aba67bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:15.293371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f937-949f-4e01-8559-3fe8aba67bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.293668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f937-949f-4e01-8559-3fe8aba67bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.293947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8f937-949f-4e01-8559-3fe8aba67bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.305407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8f937-949f-4e01-8559-3fe8aba67bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:15.307840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8f937-949f-4e01-8559-3fe8aba67bd0 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:15.319743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 875/1727] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:15.321158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.321454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.321734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.342522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:15.343943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.363602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 876/1728] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:15.365304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:15.370355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.445314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 853/1729] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 749 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:15.449200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ad548-feeb-434f-8d9e-98028348a786 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.449495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ad548-feeb-434f-8d9e-98028348a786 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.449772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ad548-feeb-434f-8d9e-98028348a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.574113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-640ad548-feeb-434f-8d9e-98028348a786 None None] MFA Rules not processed for user `dcd2ffcc344a4cebbc779c7d808f518c`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:15.581652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-640ad548-feeb-434f-8d9e-98028348a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.600049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103c8cd-f974-4a3a-85f1-ac5c3564f1ac None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:15.610332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13441e15-806e-48f9-a56b-b2bba3f37780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:15.611678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13441e15-806e-48f9-a56b-b2bba3f37780 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.612597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13441e15-806e-48f9-a56b-b2bba3f37780 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.612893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13441e15-806e-48f9-a56b-b2bba3f37780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.762632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13441e15-806e-48f9-a56b-b2bba3f37780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:15.764333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13441e15-806e-48f9-a56b-b2bba3f37780 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:15.777146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 854/1730] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:15.781413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ad548-feeb-434f-8d9e-98028348a786 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:15.809694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ad548-feeb-434f-8d9e-98028348a786 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:15.810126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 877/1731] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:15.811570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b510-23a7-4d60-9410-d3a66c6b0743 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.811859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b510-23a7-4d60-9410-d3a66c6b0743 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.812322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b510-23a7-4d60-9410-d3a66c6b0743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.828453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710ce91-1408-4153-8057-8361eda5a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:15.829929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710ce91-1408-4153-8057-8361eda5a012 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.832249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710ce91-1408-4153-8057-8361eda5a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.832741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710ce91-1408-4153-8057-8361eda5a012 admin admin] PATH_INFO: `/v3/projects/10cd878200e94af2a0d068eca122fd0c/users/7699cb30756b4d7e8c5ddabc4d0defd0/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.869049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6be0b510-23a7-4d60-9410-d3a66c6b0743 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:15.872862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6be0b510-23a7-4d60-9410-d3a66c6b0743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.890317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710ce91-1408-4153-8057-8361eda5a012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10cd878200e94af2a0d068eca122fd0c, user_id=7699cb30756b4d7e8c5ddabc4d0defd0, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:15.897508 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710ce91-1408-4153-8057-8361eda5a012 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:15.912228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 878/1732] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:15.912228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0b510-23a7-4d60-9410-d3a66c6b0743 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:15.934665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 855/1733] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:15 2022] PUT /identity/v3/projects/10cd878200e94af2a0d068eca122fd0c/users/7699cb30756b4d7e8c5ddabc4d0defd0/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:15.938814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76490fc-a103-478c-a256-f18f5024f8bc None None] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:15.944076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76490fc-a103-478c-a256-f18f5024f8bc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:15.944377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76490fc-a103-478c-a256-f18f5024f8bc None None] PATH_INFO: `/` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:15.947182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 856/1734] 10.222.0.48 () {54 vars in 912 bytes} [Thu May 26 20:13:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:15.947992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76490fc-a103-478c-a256-f18f5024f8bc None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:15.954047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c76490fc-a103-478c-a256-f18f5024f8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:15.959491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0b510-23a7-4d60-9410-d3a66c6b0743 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:15.979230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:16.055978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:16.132581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:16.133266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:16.133548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:16.133822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:16.138102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76490fc-a103-478c-a256-f18f5024f8bc None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:16.138510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:16.138827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:16.140800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:16.146459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99257403-579a-4075-b491-0bf6385149b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:16.146459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257403-579a-4075-b491-0bf6385149b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:16.146728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257403-579a-4075-b491-0bf6385149b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:16.147660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99257403-579a-4075-b491-0bf6385149b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:16.186028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 879/1735] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:16.186028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:16.220361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1dfcd0-a2fb-4b01-8700-a9902f4fca30 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:16.229478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470b6d-6bf0-48c9-881a-26aa91d53c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:16.230587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470b6d-6bf0-48c9-881a-26aa91d53c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:16.231428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470b6d-6bf0-48c9-881a-26aa91d53c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:16.232058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470b6d-6bf0-48c9-881a-26aa91d53c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:16.237572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470b6d-6bf0-48c9-881a-26aa91d53c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:16.237572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470b6d-6bf0-48c9-881a-26aa91d53c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:16.240621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470b6d-6bf0-48c9-881a-26aa91d53c0e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:16.277894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 880/1736] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:16.279636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a2a8c-c1c6-4d2e-94cd-615d76f7a41d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:16.280164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a2a8c-c1c6-4d2e-94cd-615d76f7a41d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:16.280417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15a2a8c-c1c6-4d2e-94cd-615d76f7a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:16.313291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d15a2a8c-c1c6-4d2e-94cd-615d76f7a41d None None] MFA Rules not processed for user `7699cb30756b4d7e8c5ddabc4d0defd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:16.314913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d15a2a8c-c1c6-4d2e-94cd-615d76f7a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:16.348200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99257403-579a-4075-b491-0bf6385149b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:16.350383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99257403-579a-4075-b491-0bf6385149b4 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:16.380959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 857/1737] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:16.387932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c20c-26c9-487c-985c-93c0599a6fa3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:16.388227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c20c-26c9-487c-985c-93c0599a6fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:16.388505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c20c-26c9-487c-985c-93c0599a6fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:16.459926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-33a4c20c-26c9-487c-985c-93c0599a6fa3 None None] MFA Rules not processed for user `8751982010ae4b7eb6c855aea7540a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:16.468572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-33a4c20c-26c9-487c-985c-93c0599a6fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:16.556638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 881/1738] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:16.570633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a2a8c-c1c6-4d2e-94cd-615d76f7a41d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:16.607289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15a2a8c-c1c6-4d2e-94cd-615d76f7a41d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:16.622187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:16.623197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:16.623484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:16.623762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:16.624466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:16.628569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:16.681329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 858/1739] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:16.682715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4c20c-26c9-487c-985c-93c0599a6fa3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:16.725444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 882/1740] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:16 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:16.725789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:16.732842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4c20c-26c9-487c-985c-93c0599a6fa3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:16.917760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a8346-ee01-4c79-9859-4d21c2e1db9a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:16.931169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:16.931791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:16.932128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:16.932457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:16.933912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:16.936868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:16.997964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 883/1741] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:16 2022] POST /identity/v3/projects => generated 357 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:16.998955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.009530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:17.032073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.035490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.036869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.043946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.053225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.061001 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.080523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:17.127582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d054054-3e13-44d4-bd0e-f3497606d5b6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.136864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.137540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.137836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.138194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.141740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:17.149764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 859/1742] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:16 2022] POST /identity/v3/projects => generated 403 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:17.153048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.324116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.325613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.340891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb0620-37d4-48d2-9d6d-e079502ba146 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.349804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 884/1743] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:17.350675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.352629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.353616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.353955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.354236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.355088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.357286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.401892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 860/1744] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:17 2022] POST /identity/v3/users => generated 290 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:17.404210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.420544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:17.484025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fb4983-fc4a-49ce-bf89-1933d0e81bbe service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.493718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.494418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.494715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.496623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.499260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.506513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.574986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 885/1745] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:17 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:17.582275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.604998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e8230-ac3c-4303-b5d4-503cf029a2ec admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.613916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.615512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.616112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.616713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.617875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.620446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.662349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e49c4c-e51e-43f9-8f09-90e69e6c30a0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.667532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.669562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.669919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.670771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.686316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.695349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.698343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 886/1746] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:17 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:17.700726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.706563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:17.706787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 861/1747] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:17.744139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae66cf-2170-4885-93c1-0b0080cfb09e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.749834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.758289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.759202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.759490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.759769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] PATH_INFO: `/v3/users/73f8611f29bd43bb9eb37c8435d82876` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.766467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f8611f29bd43bb9eb37c8435d82876)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.772825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.786544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec646e-c6d4-46bd-ba73-bcca2196e8ed service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.811662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.817007 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.817436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.818327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.819229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.820975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.832011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:17.858817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 862/1748] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:17.869253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.904671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c5163-b8c5-443c-bf60-675946d028d9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:17.905264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f8611f29bd43bb9eb37c8435d82876'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:17.919330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:17.920263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:17.920659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:17.921736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:17.926135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f8611f29bd43bb9eb37c8435d82876'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:17.926653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:17.929226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f8611f29bd43bb9eb37c8435d82876'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:17.938432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:17.956088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f8611f29bd43bb9eb37c8435d82876'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:17.957167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f8611f29bd43bb9eb37c8435d82876'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:17.969570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 863/1749] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:17.971083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:17.976147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:18.003515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 887/1750] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:17 2022] DELETE /identity/v3/users/73f8611f29bd43bb9eb37c8435d82876 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:18.005238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:18.009414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:18.013395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4465192-d636-4e7e-92f2-a66fe12f259e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:18.159949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:18.177866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:18.178973 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.180814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.182379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:18.184740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:18.189556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:18.216939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 864/1751] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:18.217810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:18.231982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aa5783-5ecc-4e7f-a2ef-529798e58dfe admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:18.235345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:18.255634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7404e8-66a7-4a5f-895f-0b46ae4817d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:18.256614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7404e8-66a7-4a5f-895f-0b46ae4817d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.257011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7404e8-66a7-4a5f-895f-0b46ae4817d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.259016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7404e8-66a7-4a5f-895f-0b46ae4817d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:18.261312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7404e8-66a7-4a5f-895f-0b46ae4817d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:18.263131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7404e8-66a7-4a5f-895f-0b46ae4817d7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:18.289435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87cede1-7731-4d17-82e7-c07d0277defb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:18.300056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:18.301291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.301690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.302639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] PATH_INFO: `/v3/projects/f3b8538da6914d36ac8b7ada046bdf80/users/ee5a3271cec946b6a71df589c39072d0/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:18.315569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 888/1752] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:18.318491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663da54-6f8b-4a5d-a695-d515c885ecf7 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.322016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663da54-6f8b-4a5d-a695-d515c885ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.322281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8663da54-6f8b-4a5d-a695-d515c885ecf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:18.374968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b8538da6914d36ac8b7ada046bdf80, user_id=ee5a3271cec946b6a71df589c39072d0, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:18.392952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:18.401286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8663da54-6f8b-4a5d-a695-d515c885ecf7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:18.402542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8663da54-6f8b-4a5d-a695-d515c885ecf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:18.431989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 865/1753] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:18 2022] PUT /identity/v3/projects/f3b8538da6914d36ac8b7ada046bdf80/users/ee5a3271cec946b6a71df589c39072d0/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:18.436203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:18.465232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 889/1754] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:18.466455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663da54-6f8b-4a5d-a695-d515c885ecf7 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:18.534465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8663da54-6f8b-4a5d-a695-d515c885ecf7 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:18.667079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651d475-6913-4adc-b0bf-19b47f54e6b2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:18.679807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:18.680973 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.681497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.681996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:18.683018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:18.686959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:18.735836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 866/1755] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:18.737718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:18.763274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af596e6c-8a56-4457-b2b2-9b8e2f92806a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:18.775270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:18.776110 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.776523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.777049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:18.777914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:18.787619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:18.812856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 867/1756] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:18.814025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:18.820477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:18.948609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:18.949757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.950072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.950358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] PATH_INFO: `/v3/projects/05adb0dc0bae4e72b1ebd694ae327963/users/e88aab30faf3482d895ab75b457b1199/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:18.970756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9092f7-d9b5-4ea1-9853-37ac17ab3544 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:18.975017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:18.975910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:18.976373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:18.976846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:19.011811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:19.013389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:19.021798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=05adb0dc0bae4e72b1ebd694ae327963, user_id=e88aab30faf3482d895ab75b457b1199, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:19.024908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:19.064970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 890/1757] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:18 2022] PUT /identity/v3/projects/05adb0dc0bae4e72b1ebd694ae327963/users/e88aab30faf3482d895ab75b457b1199/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:19.074826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:19.074947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 868/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:19.074947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:19.108861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:19.114955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02376c7-42dd-4f1a-9497-7cc169617d90 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:19.273224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1294d1-9344-4c17-92c5-a680079f69ad admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:19.286224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8e55-983e-4b81-8d35-5449e0a759c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:19.287725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8e55-983e-4b81-8d35-5449e0a759c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:19.288145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8e55-983e-4b81-8d35-5449e0a759c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:19.288581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8e55-983e-4b81-8d35-5449e0a759c9 admin admin] PATH_INFO: `/v3/projects/d2b65fe0d14a4c3b91d747429c967e98/users/7ac39c00f36b4d408ef2830fb11d9b96/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:19.339719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc8e55-983e-4b81-8d35-5449e0a759c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b65fe0d14a4c3b91d747429c967e98, user_id=7ac39c00f36b4d408ef2830fb11d9b96, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:19.342499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc8e55-983e-4b81-8d35-5449e0a759c9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:19.348242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:19.374156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18937ff1-d3ea-4503-98f9-33b60c8b6fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:19.378325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18937ff1-d3ea-4503-98f9-33b60c8b6fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:19.379302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18937ff1-d3ea-4503-98f9-33b60c8b6fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:19.382654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18937ff1-d3ea-4503-98f9-33b60c8b6fe4 admin admin] PATH_INFO: `/v3/projects/f3b8538da6914d36ac8b7ada046bdf80/users/ee5a3271cec946b6a71df589c39072d0/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:19.388787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18937ff1-d3ea-4503-98f9-33b60c8b6fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b8538da6914d36ac8b7ada046bdf80, user_id=ee5a3271cec946b6a71df589c39072d0, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:19.403827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18937ff1-d3ea-4503-98f9-33b60c8b6fe4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:19.413232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 891/1759] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:19 2022] PUT /identity/v3/projects/d2b65fe0d14a4c3b91d747429c967e98/users/7ac39c00f36b4d408ef2830fb11d9b96/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:19.414582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90341-813e-4cda-9783-00cc57bafabc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:19.427813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90341-813e-4cda-9783-00cc57bafabc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:19.428327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90341-813e-4cda-9783-00cc57bafabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:19.449346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 869/1760] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:19 2022] PUT /identity/v3/projects/f3b8538da6914d36ac8b7ada046bdf80/users/ee5a3271cec946b6a71df589c39072d0/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:19.460637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906878-e9a4-4856-95c1-c268a60162a4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:19.461052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906878-e9a4-4856-95c1-c268a60162a4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:19.461446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01906878-e9a4-4856-95c1-c268a60162a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:19.513216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-01906878-e9a4-4856-95c1-c268a60162a4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:19.518579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-01906878-e9a4-4856-95c1-c268a60162a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:19.577512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e3e90341-813e-4cda-9783-00cc57bafabc None None] MFA Rules not processed for user `e88aab30faf3482d895ab75b457b1199`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:19.580700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e3e90341-813e-4cda-9783-00cc57bafabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:19.761085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 870/1761] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:19.768220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa3bb2-abc8-4918-908b-676989a92107 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:19.769638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa3bb2-abc8-4918-908b-676989a92107 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:19.771080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa3bb2-abc8-4918-908b-676989a92107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:19.822480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0afa3bb2-abc8-4918-908b-676989a92107 None None] MFA Rules not processed for user `ee5a3271cec946b6a71df589c39072d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:19.824399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0afa3bb2-abc8-4918-908b-676989a92107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:19.851252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 892/1762] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:19.855256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90341-813e-4cda-9783-00cc57bafabc None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:19.887083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90341-813e-4cda-9783-00cc57bafabc None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:19.907037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:19.907965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:19.908525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:19.908965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:19.909812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:19.916691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:19.977652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 893/1763] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:19 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:19.978815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:19.992290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:20.008061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 871/1764] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:20.008992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa3bb2-abc8-4918-908b-676989a92107 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:20.048091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa3bb2-abc8-4918-908b-676989a92107 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:20.163704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a17a8d-3e75-4ec7-b29e-0ad9de8bfb80 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:20.169316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95164322-3657-4e88-8d7f-5d64ff186372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:20.170625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164322-3657-4e88-8d7f-5d64ff186372 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:20.170976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164322-3657-4e88-8d7f-5d64ff186372 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:20.171263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164322-3657-4e88-8d7f-5d64ff186372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:20.209656 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:20.235753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:20.239282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:20.244954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:20.245607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:20.246507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:20.253252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:20.310289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 872/1765] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:20 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:20.314050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:20.321398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:20.352488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:20.397396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95164322-3657-4e88-8d7f-5d64ff186372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:20.402060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95164322-3657-4e88-8d7f-5d64ff186372 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:20.425472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 894/1766] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:20.427194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e614bff-ea69-416d-93ff-8c453c0f8e52 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:20.427498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e614bff-ea69-416d-93ff-8c453c0f8e52 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:20.427776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e614bff-ea69-416d-93ff-8c453c0f8e52 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:20.431089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 895/1767] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:20.432963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e614bff-ea69-416d-93ff-8c453c0f8e52 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:20.457424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e614bff-ea69-416d-93ff-8c453c0f8e52 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:20.466736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:20.468006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:20.468387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:20.478096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:20.478096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:20.478096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:20.521723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 896/1768] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:20.522063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c319e12-19b9-4db2-8285-e69fb9fa5b47 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:20.537016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:20.537806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:20.538052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:20.538334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:20.544311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:20.563860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e8c179-305c-4595-bab7-67ece0ba344d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:20.573107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea9fb3-6904-4f18-baa1-ec6a76bccb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:20.574421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9fb3-6904-4f18-baa1-ec6a76bccb70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:20.574925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9fb3-6904-4f18-baa1-ec6a76bccb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:20.575288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9fb3-6904-4f18-baa1-ec6a76bccb70 admin admin] PATH_INFO: `/v3/projects/636dde7016f64d1b9f8c948980a7f4b7/users/67100e8712ea4b2ea7d97c2527e32e33/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:20.604891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea9fb3-6904-4f18-baa1-ec6a76bccb70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636dde7016f64d1b9f8c948980a7f4b7, user_id=67100e8712ea4b2ea7d97c2527e32e33, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:20.613611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea9fb3-6904-4f18-baa1-ec6a76bccb70 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:20.649308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 897/1769] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:20 2022] PUT /identity/v3/projects/636dde7016f64d1b9f8c948980a7f4b7/users/67100e8712ea4b2ea7d97c2527e32e33/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:20.652781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822aafb-1622-49f3-b61b-9ae835440480 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:20.653732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822aafb-1622-49f3-b61b-9ae835440480 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:20.654284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822aafb-1622-49f3-b61b-9ae835440480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:20.681043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7822aafb-1622-49f3-b61b-9ae835440480 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:20.683505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7822aafb-1622-49f3-b61b-9ae835440480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:20.817505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 898/1770] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:20.819093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822aafb-1622-49f3-b61b-9ae835440480 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:20.831682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:20.833242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:20.863036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 873/1771] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:20 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:20.982383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:20.984213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:21.041167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822aafb-1622-49f3-b61b-9ae835440480 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:21.056731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:21.057400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:21.057683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:21.058132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:21.063623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:21.085085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:21.115522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 899/1772] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:21.159604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:21.245829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:21.316069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770489c9-10fe-4537-a1f5-15f4f26d3dcc service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:21.355536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:21.356223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:21.356504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:21.356781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:21.394801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:21.396737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:21.424913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 874/1773] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:21.428339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:21.440951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5aa9-0488-433d-ac2e-1ecea0c9daa4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:21.450204 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1b564-8ae5-48f1-b5d3-879a61f51a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:21.453612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1b564-8ae5-48f1-b5d3-879a61f51a08 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:21.457125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1b564-8ae5-48f1-b5d3-879a61f51a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:21.457462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1b564-8ae5-48f1-b5d3-879a61f51a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:21.478417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddefc3f-bd57-4a2a-bbc7-62833432f093 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:21.483540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-04e1b564-8ae5-48f1-b5d3-879a61f51a08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:21.485167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:21.486198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:21.486685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:21.487321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] PATH_INFO: `/v3/projects/636dde7016f64d1b9f8c948980a7f4b7/users/67100e8712ea4b2ea7d97c2527e32e33/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:21.491338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=636dde7016f64d1b9f8c948980a7f4b7, user_id=67100e8712ea4b2ea7d97c2527e32e33, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:21.494997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:21.529932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 875/1774] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:21 2022] PUT /identity/v3/projects/636dde7016f64d1b9f8c948980a7f4b7/users/67100e8712ea4b2ea7d97c2527e32e33/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:21.534814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:21.553332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:21.661763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:21.747697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1b564-8ae5-48f1-b5d3-879a61f51a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:21.763849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1b564-8ae5-48f1-b5d3-879a61f51a08 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:21.773814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6907148c-9f32-4345-9a08-b96f53ee6b64 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:21.787237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:21.788374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:21.788829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:21.789272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] PATH_INFO: `/v3/projects/378db201417147aebcfd4539fa9ca64f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:21.791884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=378db201417147aebcfd4539fa9ca64f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:21.793323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 900/1775] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:21 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:21.796484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4d99-1757-4460-858f-7af6739a937b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:21.797915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4d99-1757-4460-858f-7af6739a937b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:21.798399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e4d99-1757-4460-858f-7af6739a937b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:21.811982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:21.888441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-179e4d99-1757-4460-858f-7af6739a937b None None] MFA Rules not processed for user `67100e8712ea4b2ea7d97c2527e32e33`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:21.890555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-179e4d99-1757-4460-858f-7af6739a937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:21.955388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378db201417147aebcfd4539fa9ca64f', 'request_id': 'req-a9c51e42-879b-4213-b442-7ca3b365e2c4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:21.979347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378db201417147aebcfd4539fa9ca64f', 'request_id': 'req-a9c51e42-879b-4213-b442-7ca3b365e2c4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:21.993062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378db201417147aebcfd4539fa9ca64f', 'request_id': 'req-a9c51e42-879b-4213-b442-7ca3b365e2c4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.041933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] The token cache is being invalidate because project 378db201417147aebcfd4539fa9ca64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:22.042596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.047885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.052836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 876/1776] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:21 2022] DELETE /identity/v3/projects/378db201417147aebcfd4539fa9ca64f => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:22.057580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:22.063353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:22.140720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 901/1777] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:22.189810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c51e42-879b-4213-b442-7ca3b365e2c4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:22.202612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:22.204446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:22.204841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:22.205231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] PATH_INFO: `/v3/users/83ce7d90b8a1453286a7c87e13745848` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:22.207280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83ce7d90b8a1453286a7c87e13745848)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:22.211352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4d99-1757-4460-858f-7af6739a937b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:22.211931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:22.215430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-179e4d99-1757-4460-858f-7af6739a937b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:22.297479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83ce7d90b8a1453286a7c87e13745848'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.299231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83ce7d90b8a1453286a7c87e13745848'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.300953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83ce7d90b8a1453286a7c87e13745848'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.306658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:22.317904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e4d99-1757-4460-858f-7af6739a937b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:22.318929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83ce7d90b8a1453286a7c87e13745848'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.329639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:22.357959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83ce7d90b8a1453286a7c87e13745848'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:22.410421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 877/1778] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:22 2022] DELETE /identity/v3/users/83ce7d90b8a1453286a7c87e13745848 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:22.476890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:22.477670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:22.477883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:22.478127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:22.484664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:22.588982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:22.595215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:22.609429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 902/1779] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:23.307778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:23.479748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05863d4-992f-44f0-8cdd-bc16641e3e82 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:23.490926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67100e8712ea4b2ea7d97c2527e32e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '636dde7016f64d1b9f8c948980a7f4b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:23.492887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:23.493183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:23.495017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:23.497567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:23.497904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:23.504369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:23.532456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 878/1780] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:13:23.533399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:23.560361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7283-ac53-4919-9933-905a65b0ade5 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:23.589509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67100e8712ea4b2ea7d97c2527e32e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '636dde7016f64d1b9f8c948980a7f4b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:23.590130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:23.590421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:23.600469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:23.602652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:23.607331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:23.653373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 903/1781] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:23 2022] POST /identity/v3/projects => generated 353 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:23.658144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:23.674650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42240c81-7904-47dc-91fe-53d6000d51ac tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:23.753142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67100e8712ea4b2ea7d97c2527e32e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '636dde7016f64d1b9f8c948980a7f4b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:23.753870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:23.754098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:23.754384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:23.755281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:23.755602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:23.757299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:23.778197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 879/1782] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:23.833415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:23.851719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80568b80-9836-42ed-aa8d-6c22039630ee tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:23.859571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67100e8712ea4b2ea7d97c2527e32e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '636dde7016f64d1b9f8c948980a7f4b7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:23.864407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:23.866174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:23.866472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] PATH_INFO: `/v3/projects/228ffb7f015a4b01b7b3ce2e64030ef6` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:23.869888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorizing `identity:delete_project(project_id=228ffb7f015a4b01b7b3ce2e64030ef6)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:23.873489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:23.942711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228ffb7f015a4b01b7b3ce2e64030ef6', 'request_id': 'req-385f86a6-3df2-4b0a-a81f-341c49d306d1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:23.950219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228ffb7f015a4b01b7b3ce2e64030ef6', 'request_id': 'req-385f86a6-3df2-4b0a-a81f-341c49d306d1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:23.965192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228ffb7f015a4b01b7b3ce2e64030ef6', 'request_id': 'req-385f86a6-3df2-4b0a-a81f-341c49d306d1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:23.995388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] The token cache is being invalidate because project 228ffb7f015a4b01b7b3ce2e64030ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:23.995786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:24.003434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:24.006357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 904/1783] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:23 2022] DELETE /identity/v3/projects/228ffb7f015a4b01b7b3ce2e64030ef6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:24.524742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:24.526656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:24.551428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:24.554297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:24.603319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:24.796363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09565758-c78b-4453-9273-38f2eb6fa11a tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:24.802245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:24.803168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:24.803528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:24.804797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] PATH_INFO: `/v3/users/e88aab30faf3482d895ab75b457b1199` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:24.808014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88aab30faf3482d895ab75b457b1199)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:24.809645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f86a6-3df2-4b0a-a81f-341c49d306d1 tempest-VolumeQuotaClassesTest-1543020897 tempest-VolumeQuotaClassesTest-1543020897-project-admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:24.815068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:24.822508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:24.823777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:24.824715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:24.826484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] PATH_INFO: `/v3/projects/54eff06485dd4984b1b1bdce0eb58d10` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:24.829052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54eff06485dd4984b1b1bdce0eb58d10)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:24.833768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:24.834006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:24.956275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88aab30faf3482d895ab75b457b1199'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:24.963317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88aab30faf3482d895ab75b457b1199'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:24.971402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88aab30faf3482d895ab75b457b1199'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:24.993635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88aab30faf3482d895ab75b457b1199'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:25.038765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bf413703-9c7a-490e-9379-e551fadc1a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88aab30faf3482d895ab75b457b1199'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:25.075294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 880/1784] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:24 2022] DELETE /identity/v3/users/e88aab30faf3482d895ab75b457b1199 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:25.079761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:25.080080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:25.080362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:25.140288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54eff06485dd4984b1b1bdce0eb58d10', 'request_id': 'req-22742861-1887-4372-862a-30cdf50adda9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:25.140417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:25.141836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:25.179397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54eff06485dd4984b1b1bdce0eb58d10', 'request_id': 'req-22742861-1887-4372-862a-30cdf50adda9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:25.189990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54eff06485dd4984b1b1bdce0eb58d10', 'request_id': 'req-22742861-1887-4372-862a-30cdf50adda9'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:25.211922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] The token cache is being invalidate because project 54eff06485dd4984b1b1bdce0eb58d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:25.212604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:25.213550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-22742861-1887-4372-862a-30cdf50adda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:25.216919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 905/1785] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:24 2022] DELETE /identity/v3/projects/54eff06485dd4984b1b1bdce0eb58d10 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:25.221434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc685caf-9ac1-496e-b174-84f00c77b77f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:25.222065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc685caf-9ac1-496e-b174-84f00c77b77f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:25.222601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc685caf-9ac1-496e-b174-84f00c77b77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:25.253687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-cc685caf-9ac1-496e-b174-84f00c77b77f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:25.256040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cc685caf-9ac1-496e-b174-84f00c77b77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:25.407755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 881/1786] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:25.460726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:25.462527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:25.679656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc759ba5-8c93-4e38-8f89-8bb072cb7027 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:25.687880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:25.687880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:25.688215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:25.689071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:25.703296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:25.705991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:25.711221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 906/1787] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:25.720108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7bce1-35e0-4c67-ba74-64711499c05a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:25.720579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7bce1-35e0-4c67-ba74-64711499c05a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:25.720882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7bce1-35e0-4c67-ba74-64711499c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:25.725376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 882/1788] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:25.746788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5fb7bce1-35e0-4c67-ba74-64711499c05a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:25.748626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5fb7bce1-35e0-4c67-ba74-64711499c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:25.813147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:25.813404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 907/1789] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:25.832474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338287-34e5-45f3-a4f8-c37292051832 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:25.860941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:25.861638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:25.861922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:25.862201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:25.862989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:25.863300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:25.871552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:25.900086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 883/1790] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:13:25.904940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7bce1-35e0-4c67-ba74-64711499c05a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:25.922524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7bce1-35e0-4c67-ba74-64711499c05a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:25.932830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:25.933778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:25.934057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:25.934328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:25.935041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:25.938462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:26.002580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 908/1791] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:25 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:26.007061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:26.024271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238396e-ee82-45dd-a111-11b4be4abd72 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:26.067329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:26.179945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:26.181103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:26.182079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:26.182966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:26.184704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:26.190155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:26.250628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:26.251149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 884/1792] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:26 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:26.267662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7747e028-3073-4455-a464-787970bbf9ea admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:26.277262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1e4ea-0e75-406a-8eba-223fc0dd8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:26.278670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1e4ea-0e75-406a-8eba-223fc0dd8536 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:26.279497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1e4ea-0e75-406a-8eba-223fc0dd8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:26.281099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1e4ea-0e75-406a-8eba-223fc0dd8536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:26.283860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1e4ea-0e75-406a-8eba-223fc0dd8536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:26.289283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1e4ea-0e75-406a-8eba-223fc0dd8536 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:26.308668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:26.315595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 909/1793] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:13:26.337051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22023f2-0513-4aa3-9617-23020fe464ba admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:26.353105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:26.360521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:26.361255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:26.361642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:26.362560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:26.364727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:26.405332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 885/1794] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:26.415104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:26.415104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:26.415587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:26.429577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:26.430736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:26.476012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc1f61e-8fc2-4800-aa1c-15c7dfc85d5d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:26.498815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e690b4f-ce06-408a-ba1c-36b211e8aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:26.501248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690b4f-ce06-408a-ba1c-36b211e8aa9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:26.502485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690b4f-ce06-408a-ba1c-36b211e8aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:26.508447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e690b4f-ce06-408a-ba1c-36b211e8aa9e admin admin] PATH_INFO: `/v3/projects/40d9a1af9114495f96036b67bd451a0b/users/a22ae75fda5f4d4aa38b9b8e12126150/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:26.513983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] MFA Rules not processed for user `7ac39c00f36b4d408ef2830fb11d9b96`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:26.515930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:26.547050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690b4f-ce06-408a-ba1c-36b211e8aa9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40d9a1af9114495f96036b67bd451a0b, user_id=a22ae75fda5f4d4aa38b9b8e12126150, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:26.550458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e690b4f-ce06-408a-ba1c-36b211e8aa9e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:26.591158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 886/1795] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:26 2022] PUT /identity/v3/projects/40d9a1af9114495f96036b67bd451a0b/users/a22ae75fda5f4d4aa38b9b8e12126150/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:26.602434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ca17-0902-4157-878d-3d7788f82569 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:26.602664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ca17-0902-4157-878d-3d7788f82569 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:26.602980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2ca17-0902-4157-878d-3d7788f82569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:26.626820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 910/1796] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:26 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:26.635959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:26.636473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:26.686646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-94d2ca17-0902-4157-878d-3d7788f82569 None None] MFA Rules not processed for user `a22ae75fda5f4d4aa38b9b8e12126150`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:26.687811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-94d2ca17-0902-4157-878d-3d7788f82569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:26.714383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5144792-0ed9-4e26-a55f-fe6e2f377ba3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:26.854240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:26.857270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:26.857883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:26.858057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:26.860520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:26.882528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:26.947571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 887/1797] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:26.955022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ca17-0902-4157-878d-3d7788f82569 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:26.973884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 911/1798] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:26 2022] POST /identity/v3/projects => generated 403 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:26.976139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2ca17-0902-4157-878d-3d7788f82569 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:26.980059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.164424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa69a3-7cec-4c39-842c-3ce8c3e298dd admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.172642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.173340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.175772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.176905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.178396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.179665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.180877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.181161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.183924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.184361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.185456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.188280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.194744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:27.249544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 912/1799] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:26 2022] POST /identity/v3/users => generated 308 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:27.253882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.266483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 888/1800] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:26 2022] POST /identity/v3/projects => generated 385 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:27.268380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.273569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9ea218-23b4-4c0d-9da1-742207f6a5aa admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.281644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:27.368224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06785781-86e5-42eb-8cc7-e49e23b2e299 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.378072 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.378895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.379283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.380220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.381162 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.383074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.413887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 889/1801] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:27 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:27.415282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.422243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:27.450060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56963d84-ffe9-4e72-9c9c-87f02b9c7121 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.457784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.459020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.459510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.459977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] PATH_INFO: `/v3/projects/05adb0dc0bae4e72b1ebd694ae327963` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.468615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=05adb0dc0bae4e72b1ebd694ae327963)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.473461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.509136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.510191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.511613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.512292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.513265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.515391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.536627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 913/1802] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:27.538044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.561372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d83cee-4a80-43b5-a9c8-30050e4dd900 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.574029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31baa96f-55d8-4159-8325-4dfb82c99056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.574790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baa96f-55d8-4159-8325-4dfb82c99056 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.579841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baa96f-55d8-4159-8325-4dfb82c99056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.580148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31baa96f-55d8-4159-8325-4dfb82c99056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.582510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31baa96f-55d8-4159-8325-4dfb82c99056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.584512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31baa96f-55d8-4159-8325-4dfb82c99056 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.600094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05adb0dc0bae4e72b1ebd694ae327963', 'request_id': 'req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:27.602859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 914/1803] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:27.604080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d742d5-8f7f-437c-b114-81570955c427 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.604369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d742d5-8f7f-437c-b114-81570955c427 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.604651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d742d5-8f7f-437c-b114-81570955c427 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.606531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 915/1804] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:27.607402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d742d5-8f7f-437c-b114-81570955c427 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.619414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05adb0dc0bae4e72b1ebd694ae327963', 'request_id': 'req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:27.627880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05adb0dc0bae4e72b1ebd694ae327963', 'request_id': 'req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:27.652698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] The token cache is being invalidate because project 05adb0dc0bae4e72b1ebd694ae327963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:27.652989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:27.654498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:27.657619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 890/1805] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:27 2022] DELETE /identity/v3/projects/05adb0dc0bae4e72b1ebd694ae327963 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:27.659768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.662679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:27.729775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d742d5-8f7f-437c-b114-81570955c427 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.741765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.742745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.743067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.743341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] PATH_INFO: `/v3/projects/49dcff3dfcca495cbd2a86a10163afc7/users/9d1fe660de8347d999cca3a3e00c5b64/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.764842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dcff3dfcca495cbd2a86a10163afc7, user_id=9d1fe660de8347d999cca3a3e00c5b64, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.769190 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.793235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 916/1806] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:27 2022] PUT /identity/v3/projects/49dcff3dfcca495cbd2a86a10163afc7/users/9d1fe660de8347d999cca3a3e00c5b64/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:27.793235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.794807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:27.806497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:27.814564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb6606b-5e7b-49d0-ae10-57dd7c6794cc admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.886345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e963cee-aab8-4124-84a0-2550be84480d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.893717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.894776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.895281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.895563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] PATH_INFO: `/v3/users/67100e8712ea4b2ea7d97c2527e32e33` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.897507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67100e8712ea4b2ea7d97c2527e32e33)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.900298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.906683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.907694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.908000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.908696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.909857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.911936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.926391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 891/1807] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:27.926391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:27.939466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:27.946801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:27.960778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3dbf8b-6e8c-4e38-a1da-a828424e2eed admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:27.966189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb04d8-5fd6-442f-8fa9-d75b46ddb7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:27.966952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb04d8-5fd6-442f-8fa9-d75b46ddb7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.967241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb04d8-5fd6-442f-8fa9-d75b46ddb7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.967516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb04d8-5fd6-442f-8fa9-d75b46ddb7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.968300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb04d8-5fd6-442f-8fa9-d75b46ddb7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:27.970089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb04d8-5fd6-442f-8fa9-d75b46ddb7c3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:27.991079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 892/1808] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:27.992819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:27.993225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:27.993673 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:27.999482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67100e8712ea4b2ea7d97c2527e32e33'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:28.020096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67100e8712ea4b2ea7d97c2527e32e33'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:28.021374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67100e8712ea4b2ea7d97c2527e32e33'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:28.026211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:28.027837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:28.046399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67100e8712ea4b2ea7d97c2527e32e33'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:28.047407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67100e8712ea4b2ea7d97c2527e32e33'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:28.072993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 917/1809] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:27 2022] DELETE /identity/v3/users/67100e8712ea4b2ea7d97c2527e32e33 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:28.074228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:28.076369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:28.128943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 893/1810] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:13:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:28.130184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:28.132765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:28.152917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ba290-af28-4fd3-adf7-b7e7a96aa732 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:28.203265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746d940-7399-4ee2-b362-81052941f3f3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:28.214140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deab3125-d0e9-47ae-8b5f-c50ed21f9c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:28.216797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3125-d0e9-47ae-8b5f-c50ed21f9c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:28.217092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3125-d0e9-47ae-8b5f-c50ed21f9c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:28.217373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab3125-d0e9-47ae-8b5f-c50ed21f9c27 admin admin] PATH_INFO: `/v3/projects/70fe7f1988664f89958098f7ab928c5c/users/73d0cb0a2bf842c0a9b8eecb1c064241/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:28.235581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:28.236882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:28.237453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:28.237951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] PATH_INFO: `/v3/projects/49dcff3dfcca495cbd2a86a10163afc7/users/9d1fe660de8347d999cca3a3e00c5b64/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:28.240601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49dcff3dfcca495cbd2a86a10163afc7, user_id=9d1fe660de8347d999cca3a3e00c5b64, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:28.244211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:28.247987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab3125-d0e9-47ae-8b5f-c50ed21f9c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70fe7f1988664f89958098f7ab928c5c, user_id=73d0cb0a2bf842c0a9b8eecb1c064241, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:28.252174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deab3125-d0e9-47ae-8b5f-c50ed21f9c27 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:28.268257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 894/1811] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:28 2022] PUT /identity/v3/projects/49dcff3dfcca495cbd2a86a10163afc7/users/9d1fe660de8347d999cca3a3e00c5b64/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:28.269550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:28.274746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:28.293238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 918/1812] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:28 2022] PUT /identity/v3/projects/70fe7f1988664f89958098f7ab928c5c/users/73d0cb0a2bf842c0a9b8eecb1c064241/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:28.310164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa338-7042-4039-ab42-d0799b3fc0e6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:28.313359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa338-7042-4039-ab42-d0799b3fc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:28.313891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbaa338-7042-4039-ab42-d0799b3fc0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:28.334156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:28.380051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9dbaa338-7042-4039-ab42-d0799b3fc0e6 None None] MFA Rules not processed for user `73d0cb0a2bf842c0a9b8eecb1c064241`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:28.382630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9dbaa338-7042-4039-ab42-d0799b3fc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:28.478435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccfb6a-ecea-4ced-9ebf-fa624eb92266 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:28.588780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 919/1813] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:28.589836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa338-7042-4039-ab42-d0799b3fc0e6 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:28.616796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:28.634378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:28.635077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:28.635361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:28.636145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:28.647711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:28.649890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:28.664141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 895/1814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:28.710516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbaa338-7042-4039-ab42-d0799b3fc0e6 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:28.718813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:28.718813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:28.719041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:28.719220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:28.720085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:28.722367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:28.756070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 920/1815] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:28 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:28.760269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:28.775007 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dba1bc-849b-44e5-b1a0-ed16a88bcd43 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:28.789292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:28.792720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:28.940521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:28.941374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:28.941700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:28.941982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:28.943657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:28.950641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:28.960614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026a0c-cccc-4fbc-91c0-d45fe4f37dd0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:28.974257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:28.977069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:28.979596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:28.979977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] PATH_INFO: `/v3/projects/636dde7016f64d1b9f8c948980a7f4b7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:28.981941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=636dde7016f64d1b9f8c948980a7f4b7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:28.987785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:28.998954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 896/1816] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:28 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:29.003795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.024012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bb634-0d9a-4958-bc1d-0ebe80fc381e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.031825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.032511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.032795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.033066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.033931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.035649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.055603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 897/1817] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:29.060674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.080200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24e77c2-2dfe-4270-8891-02703ee82561 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.096002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '636dde7016f64d1b9f8c948980a7f4b7', 'request_id': 'req-b16f3e1e-36c3-450a-8cbb-d16976812eb4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:29.103148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '636dde7016f64d1b9f8c948980a7f4b7', 'request_id': 'req-b16f3e1e-36c3-450a-8cbb-d16976812eb4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:29.108616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:29.111801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '636dde7016f64d1b9f8c948980a7f4b7', 'request_id': 'req-b16f3e1e-36c3-450a-8cbb-d16976812eb4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:29.136608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] The token cache is being invalidate because project 636dde7016f64d1b9f8c948980a7f4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:29.137445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:29.138950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b16f3e1e-36c3-450a-8cbb-d16976812eb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:29.141391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 921/1818] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:28 2022] DELETE /identity/v3/projects/636dde7016f64d1b9f8c948980a7f4b7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:29.149679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fc104-e1dd-4c1c-bdff-1da451183690 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.150093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fc104-e1dd-4c1c-bdff-1da451183690 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.150560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146fc104-e1dd-4c1c-bdff-1da451183690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.178738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-146fc104-e1dd-4c1c-bdff-1da451183690 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:29.180146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-146fc104-e1dd-4c1c-bdff-1da451183690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:29.193176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.194086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.194825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.195156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] PATH_INFO: `/v3/projects/39faaea721d748e49634fc791854535a/users/1b1dada7f2cc4a0383500d31f3567bc4/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.209328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:29.218086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39faaea721d748e49634fc791854535a, user_id=1b1dada7f2cc4a0383500d31f3567bc4, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.221677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.242161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 898/1819] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:29 2022] PUT /identity/v3/projects/39faaea721d748e49634fc791854535a/users/1b1dada7f2cc4a0383500d31f3567bc4/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:29.246083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.248175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:29.291482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 922/1820] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:29.299634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe366-876a-4862-8e22-c7d97c01cfea None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.300328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe366-876a-4862-8e22-c7d97c01cfea None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.300831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9efe366-876a-4862-8e22-c7d97c01cfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.331202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f9efe366-876a-4862-8e22-c7d97c01cfea None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:29.333204 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f9efe366-876a-4862-8e22-c7d97c01cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:29.378180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bc3f1-edea-464d-a029-1aa8e8496c23 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.390542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.391344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.391638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.392774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.395895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.398644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.416634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 899/1821] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:13:29.421210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.421805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 923/1822] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:29.426177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efe366-876a-4862-8e22-c7d97c01cfea None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.436629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008abb2-8f5c-4616-a34c-39fbf3eca750 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.438113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9efe366-876a-4862-8e22-c7d97c01cfea None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.442292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.443226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f959-dfd9-4a11-ab12-d7313b6da8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.443641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.443993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f959-dfd9-4a11-ab12-d7313b6da8d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.444280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f959-dfd9-4a11-ab12-d7313b6da8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.444380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.444554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f959-dfd9-4a11-ab12-d7313b6da8d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.444894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] PATH_INFO: `/v3/projects/39faaea721d748e49634fc791854535a/users/1b1dada7f2cc4a0383500d31f3567bc4/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.445934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f959-dfd9-4a11-ab12-d7313b6da8d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:29.446251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f959-dfd9-4a11-ab12-d7313b6da8d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.447374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39faaea721d748e49634fc791854535a, user_id=1b1dada7f2cc4a0383500d31f3567bc4, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.449194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f959-dfd9-4a11-ab12-d7313b6da8d2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.451143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.465685 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 900/1823] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:29 2022] PUT /identity/v3/projects/39faaea721d748e49634fc791854535a/users/1b1dada7f2cc4a0383500d31f3567bc4/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:29.476039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 924/1824] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:29.476271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.478721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.479101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.479375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.530058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] MFA Rules not processed for user `1b1dada7f2cc4a0383500d31f3567bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:29.531557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:29.554474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a88c9e-4e39-453c-bb8c-c8df03798ff2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.560266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.561049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.561432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.561783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.562553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.564754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.633069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 901/1825] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:29 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:29.649982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.678892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 925/1826] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:29.688033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:29.691577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.697802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:29.761376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:29.784379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24e3e-bc14-41e3-bae5-9a1b19bd7c4b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.788179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d985a28-da21-43d8-8a82-27946ae52305 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.791240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.792082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.792831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.792831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.793586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.797628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.826159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 902/1827] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:29 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:29.828102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.840711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25901680-2edf-49d1-9bb1-8f745a191fac admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.846022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.846695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.847020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.847308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.848031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.850270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.864740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 903/1828] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:29.866195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54970845-50f3-4d29-bed6-288d1c7fc569 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.866356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.867357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970845-50f3-4d29-bed6-288d1c7fc569 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.867604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970845-50f3-4d29-bed6-288d1c7fc569 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.867888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54970845-50f3-4d29-bed6-288d1c7fc569 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.877864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee176-b527-4bc2-bcbd-0268cedb6146 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.892074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.893022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.893435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.894415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.896221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.897845 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.913123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 904/1829] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:29.918446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:29.933920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99682d4e-1600-4005-9e48-f4c4b36806b7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:29.941351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9370d8e8-550a-4a3b-946f-1a2be1ac373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:29.944928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d8e8-550a-4a3b-946f-1a2be1ac373b admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:29.946182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d8e8-550a-4a3b-946f-1a2be1ac373b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:29.946615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9370d8e8-550a-4a3b-946f-1a2be1ac373b admin admin] PATH_INFO: `/v3/projects/a91b10ffbe514ccb8142b2af9b2de608/users/cc72e2883369428d9de37b82e8db194d/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:29.962939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54970845-50f3-4d29-bed6-288d1c7fc569 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.964557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54970845-50f3-4d29-bed6-288d1c7fc569 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.965364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370d8e8-550a-4a3b-946f-1a2be1ac373b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a91b10ffbe514ccb8142b2af9b2de608, user_id=cc72e2883369428d9de37b82e8db194d, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:29.968329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9370d8e8-550a-4a3b-946f-1a2be1ac373b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:29.980160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 926/1830] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:29.986946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 905/1831] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:29 2022] PUT /identity/v3/projects/a91b10ffbe514ccb8142b2af9b2de608/users/cc72e2883369428d9de37b82e8db194d/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:30.000079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b503a9-d24a-4664-8fd3-9f6679fb4882 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.000079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b503a9-d24a-4664-8fd3-9f6679fb4882 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.000079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b503a9-d24a-4664-8fd3-9f6679fb4882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.029522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c676dc-c879-4623-af57-1f522092bb2f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.029749 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c676dc-c879-4623-af57-1f522092bb2f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.030039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c676dc-c879-4623-af57-1f522092bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.040607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b5b503a9-d24a-4664-8fd3-9f6679fb4882 None None] MFA Rules not processed for user `cc72e2883369428d9de37b82e8db194d`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:30.042612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b5b503a9-d24a-4664-8fd3-9f6679fb4882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:30.067808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-61c676dc-c879-4623-af57-1f522092bb2f None None] MFA Rules not processed for user `9d1fe660de8347d999cca3a3e00c5b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:30.069398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-61c676dc-c879-4623-af57-1f522092bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:30.201471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 927/1832] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:30.206954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b503a9-d24a-4664-8fd3-9f6679fb4882 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:30.218887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 906/1833] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:30.310804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:30.358196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b503a9-d24a-4664-8fd3-9f6679fb4882 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:30.368354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:30.369172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.369600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.369976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.370931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:30.373191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:30.415521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 928/1834] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:30 2022] POST /identity/v3/projects => generated 393 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:30.415999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c676dc-c879-4623-af57-1f522092bb2f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:30.434350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c676dc-c879-4623-af57-1f522092bb2f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:30.501145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:30.555427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:30.557211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.557662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.559263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.564609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:30.569377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:30.597155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 907/1835] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:30 2022] POST /identity/v3/users => generated 303 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:30.601383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:30.613466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d9073-b3e8-4520-bd29-a7ee9ebbe434 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:30.630130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:30.636554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.636913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.637268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.638294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:30.649580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:30.666402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 929/1836] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:30.675572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:30.703700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efffad-85b8-4833-8f88-0b9d6ccdc494 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:30.728013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:30.728867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.729318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.730892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] PATH_INFO: `/v3/projects/eb195b0495d84175845cff97df004400/users/deca3006b5b3481880a6ca24c4af1030/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.766313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb195b0495d84175845cff97df004400, user_id=deca3006b5b3481880a6ca24c4af1030, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:30.769344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:30.788626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 908/1837] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:30 2022] PUT /identity/v3/projects/eb195b0495d84175845cff97df004400/users/deca3006b5b3481880a6ca24c4af1030/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:30.792761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:30.813428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5a40e-2fa8-412f-bdd2-47922a8132e9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:30.895329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:30.896218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.896511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.896788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.897881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:30.899529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:30.911253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 930/1838] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:30.923735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:30.932585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:30.958630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f9c6f7-0002-409b-8951-1eebeb85dcb7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:30.967035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd335872-0978-4c92-9442-79dc767efb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:30.967940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd335872-0978-4c92-9442-79dc767efb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:30.968314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd335872-0978-4c92-9442-79dc767efb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:30.968506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd335872-0978-4c92-9442-79dc767efb1b admin admin] PATH_INFO: `/v3/projects/eb195b0495d84175845cff97df004400/users/deca3006b5b3481880a6ca24c4af1030/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:30.970992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd335872-0978-4c92-9442-79dc767efb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb195b0495d84175845cff97df004400, user_id=deca3006b5b3481880a6ca24c4af1030, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:30.974268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd335872-0978-4c92-9442-79dc767efb1b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:30.990739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 909/1839] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:30 2022] PUT /identity/v3/projects/eb195b0495d84175845cff97df004400/users/deca3006b5b3481880a6ca24c4af1030/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:31.001578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:31.001882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:31.002169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:31.038014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3636d-ec80-492e-b2ac-cd29a77afc1d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:31.067820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] MFA Rules not processed for user `deca3006b5b3481880a6ca24c4af1030`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:31.067820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:31.166098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049a54b-ed44-412c-bc96-68503856e870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:31.167899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a54b-ed44-412c-bc96-68503856e870 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:31.167899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a54b-ed44-412c-bc96-68503856e870 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:31.168721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049a54b-ed44-412c-bc96-68503856e870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:31.171575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7049a54b-ed44-412c-bc96-68503856e870 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:31.191583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 910/1840] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:31.206818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:31.228751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:31.230996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:31.242797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b4989b-e701-4f0f-bb55-f08e5ea5050a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:31.247213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:31.247865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:31.248146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:31.248418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:31.257912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:31.259404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:31.262102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049a54b-ed44-412c-bc96-68503856e870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:31.263633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049a54b-ed44-412c-bc96-68503856e870 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:31.268830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 911/1841] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:31.273508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 931/1842] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:31.354407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:31.363093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d2957-9377-42c0-b2a3-47af8bfee8fe service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:31.369480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba00569-de62-4a2e-9322-306b3840b3b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:31.370124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba00569-de62-4a2e-9322-306b3840b3b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:31.370406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba00569-de62-4a2e-9322-306b3840b3b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:31.370678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba00569-de62-4a2e-9322-306b3840b3b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:31.433396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba00569-de62-4a2e-9322-306b3840b3b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:31.435171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba00569-de62-4a2e-9322-306b3840b3b5 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:31.440266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:31.445938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 912/1843] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:31.797266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b425-147b-4736-910a-8e09de377c70 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:31.798659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b425-147b-4736-910a-8e09de377c70 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:31.799476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b425-147b-4736-910a-8e09de377c70 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:31.802823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 932/1844] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:13:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:31.829402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:31.829612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:31.830229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:31.852012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:31.853588 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:31.946689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 913/1845] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:13:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:32.132320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b425-147b-4736-910a-8e09de377c70 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:32.134500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2fa0b425-147b-4736-910a-8e09de377c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:32.178923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b425-147b-4736-910a-8e09de377c70 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:32.187615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:32.187786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:32.188124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:32.188630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:32.210176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:32.212642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:32.233649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 933/1846] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:32.655029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:32.656519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:32.722573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e21248f-426f-422d-8761-3671ae9e7b7e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:32.728257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:32.729152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:32.729445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:32.729755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] PATH_INFO: `/v3/users/7ac39c00f36b4d408ef2830fb11d9b96` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:32.731079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac39c00f36b4d408ef2830fb11d9b96)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:32.732985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:32.795324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac39c00f36b4d408ef2830fb11d9b96'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:32.796040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac39c00f36b4d408ef2830fb11d9b96'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:32.796662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac39c00f36b4d408ef2830fb11d9b96'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:32.817705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac39c00f36b4d408ef2830fb11d9b96'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:32.836414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac39c00f36b4d408ef2830fb11d9b96'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:32.855087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 914/1847] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:32 2022] DELETE /identity/v3/users/7ac39c00f36b4d408ef2830fb11d9b96 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:33.124540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:33.140356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd05d2-fd99-4313-a9ae-cb0c403eda9c service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:33.272077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:33.273047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:33.273551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:33.274115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] PATH_INFO: `/v3/projects/d2b65fe0d14a4c3b91d747429c967e98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:33.275555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b65fe0d14a4c3b91d747429c967e98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:33.277707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:33.389879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b65fe0d14a4c3b91d747429c967e98', 'request_id': 'req-a9d90a57-0130-4e45-a9fa-c79a12ef5242'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.399234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b65fe0d14a4c3b91d747429c967e98', 'request_id': 'req-a9d90a57-0130-4e45-a9fa-c79a12ef5242'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.410080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b65fe0d14a4c3b91d747429c967e98', 'request_id': 'req-a9d90a57-0130-4e45-a9fa-c79a12ef5242'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.440388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] The token cache is being invalidate because project d2b65fe0d14a4c3b91d747429c967e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:33.440524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.443370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.450461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 934/1848] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:33 2022] DELETE /identity/v3/projects/d2b65fe0d14a4c3b91d747429c967e98 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:33.451362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:33.453192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:33.477700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b404-aa6c-4d93-9140-a1352d045748 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:33.522601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:33.612296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:33.614417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:33.615225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:33.615642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] PATH_INFO: `/v3/users/9d1fe660de8347d999cca3a3e00c5b64` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:33.617406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d1fe660de8347d999cca3a3e00c5b64)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:33.620591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:33.705918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d1fe660de8347d999cca3a3e00c5b64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.710333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d1fe660de8347d999cca3a3e00c5b64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.711887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d1fe660de8347d999cca3a3e00c5b64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.732857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d1fe660de8347d999cca3a3e00c5b64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.754097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bd05827-b309-409a-b8e7-13bcf77901e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d1fe660de8347d999cca3a3e00c5b64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:33.779834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 915/1849] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:33 2022] DELETE /identity/v3/users/9d1fe660de8347d999cca3a3e00c5b64 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:34.389179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:34.391339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:34.408065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d90a57-0130-4e45-a9fa-c79a12ef5242 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:34.486750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:34.549514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:34.550646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.551861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.554339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] PATH_INFO: `/v3/projects/49dcff3dfcca495cbd2a86a10163afc7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:34.555778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49dcff3dfcca495cbd2a86a10163afc7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:34.558410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:34.654706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49dcff3dfcca495cbd2a86a10163afc7', 'request_id': 'req-477fdfe7-600c-432c-bb29-98100b753f83'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:34.663127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49dcff3dfcca495cbd2a86a10163afc7', 'request_id': 'req-477fdfe7-600c-432c-bb29-98100b753f83'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:34.679632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49dcff3dfcca495cbd2a86a10163afc7', 'request_id': 'req-477fdfe7-600c-432c-bb29-98100b753f83'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:34.699579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] The token cache is being invalidate because project 49dcff3dfcca495cbd2a86a10163afc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:34.700142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:34.701121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-477fdfe7-600c-432c-bb29-98100b753f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:34.703146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 935/1850] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:34 2022] DELETE /identity/v3/projects/49dcff3dfcca495cbd2a86a10163afc7 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:34.711979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998913-c056-420a-9161-8a4468e64219 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.712701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998913-c056-420a-9161-8a4468e64219 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.712990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1998913-c056-420a-9161-8a4468e64219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:34.736571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e1998913-c056-420a-9161-8a4468e64219 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:34.738040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e1998913-c056-420a-9161-8a4468e64219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:34.773286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91b69-65c4-441a-9b64-93818ce9e431 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.773883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91b69-65c4-441a-9b64-93818ce9e431 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.774584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e91b69-65c4-441a-9b64-93818ce9e431 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:34.777573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 936/1851] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:13:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:13:34.787175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.787474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.787754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:34.814918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:34.816172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:34.824371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 916/1852] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:34.834666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f60c-f5a8-45ff-8c70-3881641b7cd8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.835009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f60c-f5a8-45ff-8c70-3881641b7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.835441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f60c-f5a8-45ff-8c70-3881641b7cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:34.872147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4e25f60c-f5a8-45ff-8c70-3881641b7cd8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:34.873539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4e25f60c-f5a8-45ff-8c70-3881641b7cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:34.887891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 917/1853] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:34.889645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f60c-f5a8-45ff-8c70-3881641b7cd8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:34.903717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f60c-f5a8-45ff-8c70-3881641b7cd8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:34.910296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:34.911184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.911823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.912202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:34.913220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:34.913719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:34.915902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:34.929335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 937/1854] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:13:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:34.945318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:34.947147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:34.952461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 918/1855] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:13:34.956971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:34.972482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107f264-c6fc-4332-9941-2f39a77a4a53 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:34.978529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16bf6d-49d4-40ac-9333-25f927e0db8f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:34.986924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:34.986924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.986924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.986924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:34.987894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:34.990418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:34.991359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:34.992203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:34.992491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:34.992770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.003397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.006622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.010268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:35.019567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 938/1856] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:35.028303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 919/1857] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:34 2022] POST /identity/v3/projects => generated 401 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:35.029580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.040634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dcb0b-8e1b-481b-ba89-45f79d77aa91 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.082546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:35.104483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.105163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.105447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.105725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.106419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.108367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.130166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 939/1858] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:35 2022] POST /identity/v3/users => generated 301 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:35.139606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.151327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa7091-5cb0-4683-a035-e5416e9b8968 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.156582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.157326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.157605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.157926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.158729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.160357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.171203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 920/1859] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:35.175297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.190420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ff7d3-b20f-49b1-b19f-b7c9d8bb79f3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.196168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c536-f797-4017-92df-61844ac4ba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.196915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c536-f797-4017-92df-61844ac4ba56 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.197380 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c536-f797-4017-92df-61844ac4ba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.197744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c536-f797-4017-92df-61844ac4ba56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.198553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0c536-f797-4017-92df-61844ac4ba56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.200252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0c536-f797-4017-92df-61844ac4ba56 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.211347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 940/1860] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:13:35.215903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.228382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3baad3c-ef42-4a46-b3f9-04c1aaa10347 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.233178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.234207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.234564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.234967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] PATH_INFO: `/v3/projects/49a9f71c20b44d9b948aa7dc0c808b61/users/d14d306ffb0448009faf4bcc59336917/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.251869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49a9f71c20b44d9b948aa7dc0c808b61, user_id=d14d306ffb0448009faf4bcc59336917, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.254682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.279063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 921/1861] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:35 2022] PUT /identity/v3/projects/49a9f71c20b44d9b948aa7dc0c808b61/users/d14d306ffb0448009faf4bcc59336917/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:35.285148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e27e-f4e0-419a-bd61-71e60cabdb66 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.286548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e27e-f4e0-419a-bd61-71e60cabdb66 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.287072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010e27e-f4e0-419a-bd61-71e60cabdb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.320475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f010e27e-f4e0-419a-bd61-71e60cabdb66 None None] MFA Rules not processed for user `d14d306ffb0448009faf4bcc59336917`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:35.321814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f010e27e-f4e0-419a-bd61-71e60cabdb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:35.396985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 941/1862] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:35.401335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.465169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219946a3-17df-446b-b5a2-93be7411d90e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.469926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.470590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.470959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.471331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.472263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.474691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.502669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 922/1863] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:35 2022] POST /identity/v3/projects => generated 401 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:35.506875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e27e-f4e0-419a-bd61-71e60cabdb66 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.517367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010e27e-f4e0-419a-bd61-71e60cabdb66 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.587226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.587911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.588196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.588576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.589319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.591286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.617373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 942/1864] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:35 2022] POST /identity/v3/users => generated 307 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:35.621797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.642365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed476-ea4d-44df-9ae8-471ca221c534 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.649439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.650275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.650822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.651309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.652258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.653954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.663002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.665299 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:35.668947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 923/1865] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:35.674025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.687597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b41e91-0d38-47d8-af87-63e1ecda2be0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.687709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f28b6a-9453-4388-9aff-26fbc218232c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.691463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.692259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.692582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.692919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.693205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] PATH_INFO: `/v3/projects/608d5b2d1c34470392be1a19f6bdced2/users/408ff3bb84754f5fa8e7d8de272674c1/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.693411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.693755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.694094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] PATH_INFO: `/v3/users/cc72e2883369428d9de37b82e8db194d` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.696330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc72e2883369428d9de37b82e8db194d)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.698366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.712279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=608d5b2d1c34470392be1a19f6bdced2, user_id=408ff3bb84754f5fa8e7d8de272674c1, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.715053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.732918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 924/1866] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:35 2022] PUT /identity/v3/projects/608d5b2d1c34470392be1a19f6bdced2/users/408ff3bb84754f5fa8e7d8de272674c1/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:35.737873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.739996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:35.761584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc72e2883369428d9de37b82e8db194d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:35.773153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc72e2883369428d9de37b82e8db194d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:35.773796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc72e2883369428d9de37b82e8db194d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:35.791067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc72e2883369428d9de37b82e8db194d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:35.791994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e6f10373-84b1-4aa7-b856-f3aaa1ab5f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc72e2883369428d9de37b82e8db194d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:35.809093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 943/1867] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:35 2022] DELETE /identity/v3/users/cc72e2883369428d9de37b82e8db194d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:35.813372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.813564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.813856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.830621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79400ae4-d888-4fe5-bf45-1af3d466ddb2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.831697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:35.834205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:35.844459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:35.898091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.898710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.899038 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.899316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.900046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.901647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.905600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 944/1868] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:35.906500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.908180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:35.915465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 925/1869] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:35.916801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.918434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:35.930627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98160e03-c05e-40c3-9cb3-4b0c8009ddad admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:35.935564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:35.936465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:35.936777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:35.937015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] PATH_INFO: `/v3/projects/608d5b2d1c34470392be1a19f6bdced2/users/408ff3bb84754f5fa8e7d8de272674c1/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:35.939025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=608d5b2d1c34470392be1a19f6bdced2, user_id=408ff3bb84754f5fa8e7d8de272674c1, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:35.941705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:35.952541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 926/1870] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:35 2022] PUT /identity/v3/projects/608d5b2d1c34470392be1a19f6bdced2/users/408ff3bb84754f5fa8e7d8de272674c1/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:35.962123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:35.962123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:35.969660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d912bb0-64f8-42ed-84e2-5abc95a7c381 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:36.014954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4194e58-a53e-485a-b952-5ac3f8cf47ef admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:36.019112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d26b3-2950-47f6-b1d1-3e184a1f6adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:36.020592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d26b3-2950-47f6-b1d1-3e184a1f6adf service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:36.021352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d26b3-2950-47f6-b1d1-3e184a1f6adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:36.021840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d26b3-2950-47f6-b1d1-3e184a1f6adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:36.022046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:36.022603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:36.023040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:36.023325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:36.025916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:36.046457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:36.089711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d26b3-2950-47f6-b1d1-3e184a1f6adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:36.091202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d26b3-2950-47f6-b1d1-3e184a1f6adf service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:36.101369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 927/1871] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:36.102668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:36.103000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:36.103285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:36.110938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:36.112742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:36.131779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 945/1872] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:36.135175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] MFA Rules not processed for user `408ff3bb84754f5fa8e7d8de272674c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:36.136446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:36.234506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:36.302139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 928/1873] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:36 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:36.314416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:36.316366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:36.332068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f418b8-4d9b-4145-899e-a5c987d26674 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:36.352350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:36.353145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:36.353993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:36.354515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:36.374322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:36.375786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:36.403847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 946/1874] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:36.562279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:36.564993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:36.593416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8766c-cef2-4164-9078-025ca349a27a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:36.608746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:36.610054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:36.610804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:36.612958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] PATH_INFO: `/v3/projects/a91b10ffbe514ccb8142b2af9b2de608` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:36.618309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a91b10ffbe514ccb8142b2af9b2de608)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:36.620527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:36.705685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:36.718766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed803a36-f30e-46f0-81af-e654ab1a138c service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:36.763046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a91b10ffbe514ccb8142b2af9b2de608', 'request_id': 'req-b3d539ec-f7d5-4380-be8e-2522f29b4dee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:36.787984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a91b10ffbe514ccb8142b2af9b2de608', 'request_id': 'req-b3d539ec-f7d5-4380-be8e-2522f29b4dee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:36.797638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a91b10ffbe514ccb8142b2af9b2de608', 'request_id': 'req-b3d539ec-f7d5-4380-be8e-2522f29b4dee'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:36.826449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] The token cache is being invalidate because project a91b10ffbe514ccb8142b2af9b2de608 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:36.826821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:36.827647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:36.829836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 929/1875] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:36 2022] DELETE /identity/v3/projects/a91b10ffbe514ccb8142b2af9b2de608 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:36.834589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:36.836711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:36.894590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:36.895341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:36.895635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:36.896473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:36.897965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:36.982896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d539ec-f7d5-4380-be8e-2522f29b4dee admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:36.991821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:36.992953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:36.994100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:36.994639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] PATH_INFO: `/v3/users/deca3006b5b3481880a6ca24c4af1030` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:36.997391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deca3006b5b3481880a6ca24c4af1030)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:37.004833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:37.027096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:37.028604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:37.046606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 947/1876] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:37.113452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deca3006b5b3481880a6ca24c4af1030'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.114195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deca3006b5b3481880a6ca24c4af1030'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.114855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deca3006b5b3481880a6ca24c4af1030'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.125784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deca3006b5b3481880a6ca24c4af1030'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.129036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:37.147684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-44cca1cd-c0a8-452a-8ed9-833ccee7fc10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deca3006b5b3481880a6ca24c4af1030'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.178916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 930/1877] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:36 2022] DELETE /identity/v3/users/deca3006b5b3481880a6ca24c4af1030 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:37.759976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:37.776080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59f5d8-3656-4046-94a2-02e2bbe291b8 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:37.869822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:37.870702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:37.871092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:37.871426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] PATH_INFO: `/v3/projects/eb195b0495d84175845cff97df004400` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:37.872618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb195b0495d84175845cff97df004400)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:37.874527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:37.877129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:37.928552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb195b0495d84175845cff97df004400', 'request_id': 'req-eaa995af-99fe-4c85-adec-43e672bcd5f7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.935774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb195b0495d84175845cff97df004400', 'request_id': 'req-eaa995af-99fe-4c85-adec-43e672bcd5f7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.944898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb195b0495d84175845cff97df004400', 'request_id': 'req-eaa995af-99fe-4c85-adec-43e672bcd5f7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.960594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] The token cache is being invalidate because project eb195b0495d84175845cff97df004400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:37.960953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.961671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-eaa995af-99fe-4c85-adec-43e672bcd5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:37.966979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 948/1878] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:37 2022] DELETE /identity/v3/projects/eb195b0495d84175845cff97df004400 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:37.969236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bca5c-0f5c-45a2-8dbe-ac42bed40573 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:37.969717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bca5c-0f5c-45a2-8dbe-ac42bed40573 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:37.969904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bca5c-0f5c-45a2-8dbe-ac42bed40573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:37.990677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a57bca5c-0f5c-45a2-8dbe-ac42bed40573 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:37.992026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a57bca5c-0f5c-45a2-8dbe-ac42bed40573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:38.061718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 931/1879] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:38.069725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4342-20f4-42f3-88d1-3e817b96df84 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.070085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4342-20f4-42f3-88d1-3e817b96df84 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.070366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439e4342-20f4-42f3-88d1-3e817b96df84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.088650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-439e4342-20f4-42f3-88d1-3e817b96df84 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:38.089852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-439e4342-20f4-42f3-88d1-3e817b96df84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:38.098354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 949/1880] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:38.102728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bca5c-0f5c-45a2-8dbe-ac42bed40573 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.112258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bca5c-0f5c-45a2-8dbe-ac42bed40573 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.118168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.118869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.119166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.119445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.120171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:38.120470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.122115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.134658 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 932/1881] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:38.139109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4342-20f4-42f3-88d1-3e817b96df84 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.149990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439e4342-20f4-42f3-88d1-3e817b96df84 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.155800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.156659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.156975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.157309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.158128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.160163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.185956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 950/1882] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:38 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:38.190043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.201665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58765d0f-de00-45c2-bd13-445a97481419 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.259253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.259956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.260239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.260516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.261211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.263211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.281952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 933/1883] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:38 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:38.286504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.296547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046bafe-b6a4-4570-9947-41e2fcac2258 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.301146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.302314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.302601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.302916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.303615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.305202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.315830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 951/1884] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:13:38.319842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.330108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb77735-0016-4cc7-b731-8077d08562cf admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.334962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f62cdc-b5ff-4648-a892-a5a3f940afc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.335657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f62cdc-b5ff-4648-a892-a5a3f940afc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.335942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f62cdc-b5ff-4648-a892-a5a3f940afc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.336221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f62cdc-b5ff-4648-a892-a5a3f940afc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.336951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f62cdc-b5ff-4648-a892-a5a3f940afc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.338532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f62cdc-b5ff-4648-a892-a5a3f940afc1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.351043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 934/1885] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:38.355222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.365510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5d14c-35f3-4e19-9d9f-d13ced6b5e19 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.370075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.370991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.371278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.371553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] PATH_INFO: `/v3/projects/30ca7847dd7b4940b6e98fa5788f9900/users/f7b1fc965d374a31b4787b57e757ea10/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.386927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ca7847dd7b4940b6e98fa5788f9900, user_id=f7b1fc965d374a31b4787b57e757ea10, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.389511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.404545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 952/1886] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:38 2022] PUT /identity/v3/projects/30ca7847dd7b4940b6e98fa5788f9900/users/f7b1fc965d374a31b4787b57e757ea10/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:38.417277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322e9b-73f7-4819-a8c5-9d147e15d15e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.417676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322e9b-73f7-4819-a8c5-9d147e15d15e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.418031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0322e9b-73f7-4819-a8c5-9d147e15d15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.453539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b0322e9b-73f7-4819-a8c5-9d147e15d15e None None] MFA Rules not processed for user `f7b1fc965d374a31b4787b57e757ea10`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:38.454440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b0322e9b-73f7-4819-a8c5-9d147e15d15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:38.490358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:38.527150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 935/1887] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:38.531626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.596629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce930d-7b51-4562-8336-f1641904c588 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.601909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.602618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.602911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.603188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.603869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.606036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.636108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 953/1888] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:38 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:38.640120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322e9b-73f7-4819-a8c5-9d147e15d15e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.651484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0322e9b-73f7-4819-a8c5-9d147e15d15e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.710731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.711430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.711670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.711971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.712681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.714877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.741249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 936/1889] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:38 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:38.745561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.758041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46070292-4139-41ff-b386-b1c32b823bba admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.763321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.764160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.764659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.765215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.766203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.768252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.784215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 954/1890] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:38.785291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.797782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f5462-4131-44f2-af5d-fff3de284f03 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.804112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.805096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.805379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.805650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] PATH_INFO: `/v3/projects/e064be588c3948a38e56ba0d61556459/users/46935a554623446bbe97c5a7a980c638/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.844968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e064be588c3948a38e56ba0d61556459, user_id=46935a554623446bbe97c5a7a980c638, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.853128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.877997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 937/1891] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:38 2022] PUT /identity/v3/projects/e064be588c3948a38e56ba0d61556459/users/46935a554623446bbe97c5a7a980c638/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:38.881739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:38.887450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:38.893408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7b1f5-1f4b-4d8f-9199-c592e9f19228 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:38.983345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff00964-3315-4936-925a-bf91358a2ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:38.984057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff00964-3315-4936-925a-bf91358a2ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:38.984343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff00964-3315-4936-925a-bf91358a2ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:38.984622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff00964-3315-4936-925a-bf91358a2ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:38.985501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff00964-3315-4936-925a-bf91358a2ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:38.987146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff00964-3315-4936-925a-bf91358a2ca9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:38.999746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 955/1892] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:39.004042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:39.019079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d5da6-387a-4b2d-83a6-ea19845585e9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:39.025197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:39.027496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:39.027496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:39.027496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] PATH_INFO: `/v3/projects/e064be588c3948a38e56ba0d61556459/users/46935a554623446bbe97c5a7a980c638/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:39.029014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e064be588c3948a38e56ba0d61556459, user_id=46935a554623446bbe97c5a7a980c638, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:39.033450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:39.047519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 938/1893] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:39 2022] PUT /identity/v3/projects/e064be588c3948a38e56ba0d61556459/users/46935a554623446bbe97c5a7a980c638/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:39.057823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630040c3-98ae-4add-9fd5-67e6073ca53a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:39.058833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630040c3-98ae-4add-9fd5-67e6073ca53a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:39.059337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630040c3-98ae-4add-9fd5-67e6073ca53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:39.126730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-630040c3-98ae-4add-9fd5-67e6073ca53a None None] MFA Rules not processed for user `46935a554623446bbe97c5a7a980c638`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:39.128015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-630040c3-98ae-4add-9fd5-67e6073ca53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:39.265803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 956/1894] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:39.391164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:39.392942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:39.461880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ace6d60-7828-4329-ba60-321026bf3cb1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:39.466293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:39.467012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:39.467305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:39.467584 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:39.477468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:39.478918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:39.498604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 939/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:39.891786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630040c3-98ae-4add-9fd5-67e6073ca53a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:39.901996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630040c3-98ae-4add-9fd5-67e6073ca53a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:39.906043 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2687f7-3d1e-4d34-a8a9-8d09d42b7137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:39.906571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2687f7-3d1e-4d34-a8a9-8d09d42b7137 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:39.906880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2687f7-3d1e-4d34-a8a9-8d09d42b7137 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:39.907152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2687f7-3d1e-4d34-a8a9-8d09d42b7137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:39.990448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2687f7-3d1e-4d34-a8a9-8d09d42b7137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:39.992197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2687f7-3d1e-4d34-a8a9-8d09d42b7137 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:40.005256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 957/1896] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:40.127384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:40.128904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:40.172202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:40.219688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c9231-b042-47d3-be91-a07cceaa09f2 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:40.224567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:40.225507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:40.225742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:40.226051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] PATH_INFO: `/v3/users/a22ae75fda5f4d4aa38b9b8e12126150` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:40.227567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a22ae75fda5f4d4aa38b9b8e12126150)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:40.229492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:40.284933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a22ae75fda5f4d4aa38b9b8e12126150'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:40.285769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a22ae75fda5f4d4aa38b9b8e12126150'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:40.286379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a22ae75fda5f4d4aa38b9b8e12126150'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:40.295518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a22ae75fda5f4d4aa38b9b8e12126150'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:40.310995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a22ae75fda5f4d4aa38b9b8e12126150'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:40.329513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 940/1897] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:40 2022] DELETE /identity/v3/users/a22ae75fda5f4d4aa38b9b8e12126150 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:40.334573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:40.334857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:40.335085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:40.357644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:40.358913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:40.387087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:40.440944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 958/1898] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:40.453134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:40.456217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:40.587663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a27409-306a-43bd-a8fc-d7e5bb539584 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:40.592528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:40.593385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:40.593687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:40.593967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:40.605340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:40.607573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:40.619017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 941/1899] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:41.064535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:41.066556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:41.082466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26702ff-045d-4a29-b027-e042945b6a55 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:41.088059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:41.089058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:41.089410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:41.089753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] PATH_INFO: `/v3/users/7699cb30756b4d7e8c5ddabc4d0defd0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:41.091069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7699cb30756b4d7e8c5ddabc4d0defd0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:41.093173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:41.133932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:41.136346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:41.179136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff80cab-b8d1-4f55-ad9e-4cbbbb451570 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:41.184260 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:41.185282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:41.186545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:41.187213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] PATH_INFO: `/v3/projects/40d9a1af9114495f96036b67bd451a0b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:41.188597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40d9a1af9114495f96036b67bd451a0b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:41.190874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:41.192450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7699cb30756b4d7e8c5ddabc4d0defd0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.202115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7699cb30756b4d7e8c5ddabc4d0defd0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.203639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7699cb30756b4d7e8c5ddabc4d0defd0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.218802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7699cb30756b4d7e8c5ddabc4d0defd0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.219545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-679c9c70-d2e6-4395-a96a-28f92ede7cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7699cb30756b4d7e8c5ddabc4d0defd0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.236586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 959/1900] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:41 2022] DELETE /identity/v3/users/7699cb30756b4d7e8c5ddabc4d0defd0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:41.247985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:41.248345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:41.248703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:41.252242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:41.258133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40d9a1af9114495f96036b67bd451a0b', 'request_id': 'req-971944d2-d9b2-4bd4-a9b7-7260320cfea9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.268738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40d9a1af9114495f96036b67bd451a0b', 'request_id': 'req-971944d2-d9b2-4bd4-a9b7-7260320cfea9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.269269 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:41.270543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:41.276473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40d9a1af9114495f96036b67bd451a0b', 'request_id': 'req-971944d2-d9b2-4bd4-a9b7-7260320cfea9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.300662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] The token cache is being invalidate because project 40d9a1af9114495f96036b67bd451a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:41.301664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.302368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.306885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 942/1901] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:41 2022] DELETE /identity/v3/projects/40d9a1af9114495f96036b67bd451a0b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:41.309831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:41.312268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:41.357514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 960/1902] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:41.367971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:41.369709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:41.396527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971944d2-d9b2-4bd4-a9b7-7260320cfea9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:41.404445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:41.405448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:41.405755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:41.406031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] PATH_INFO: `/v3/users/73d0cb0a2bf842c0a9b8eecb1c064241` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:41.407410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d0cb0a2bf842c0a9b8eecb1c064241)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:41.410090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:41.441376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:41.481596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d0cb0a2bf842c0a9b8eecb1c064241'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.481832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d0cb0a2bf842c0a9b8eecb1c064241'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.482593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d0cb0a2bf842c0a9b8eecb1c064241'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.486833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb3455b-2981-4d99-8e9f-2527cdee08eb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:41.491312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:41.492265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:41.492636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:41.493137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:41.495349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:41.495575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d0cb0a2bf842c0a9b8eecb1c064241'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.509933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d0cb0a2bf842c0a9b8eecb1c064241'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:41.515423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:41.516893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:41.528065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 961/1903] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:41.533684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 943/1904] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:41 2022] DELETE /identity/v3/users/73d0cb0a2bf842c0a9b8eecb1c064241 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:41.928831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:41.930907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:41.947133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104592-2bdb-4fd7-929c-dfea5dcc4f3e service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:42.033230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:42.034898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:42.064904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:42.065946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:42.066308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:42.067386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] PATH_INFO: `/v3/projects/10cd878200e94af2a0d068eca122fd0c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:42.069003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] RBAC: Authorizing `identity:delete_project(project_id=10cd878200e94af2a0d068eca122fd0c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:42.071366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:42.116769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:42.132972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3767364e-fc1d-4036-9646-98e4dfa3f32e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:42.145710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10cd878200e94af2a0d068eca122fd0c', 'request_id': 'req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.152070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10cd878200e94af2a0d068eca122fd0c', 'request_id': 'req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.158643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10cd878200e94af2a0d068eca122fd0c', 'request_id': 'req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.174214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] The token cache is being invalidate because project 10cd878200e94af2a0d068eca122fd0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:42.174860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.175730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.177869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 962/1905] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:41 2022] DELETE /identity/v3/projects/10cd878200e94af2a0d068eca122fd0c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:42.178940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:42.180778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:42.209781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:42.210690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:42.211041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:42.211319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] PATH_INFO: `/v3/users/d14d306ffb0448009faf4bcc59336917` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:42.221291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d14d306ffb0448009faf4bcc59336917)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:42.221291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:42.265844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd14d306ffb0448009faf4bcc59336917'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.266487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd14d306ffb0448009faf4bcc59336917'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.267115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd14d306ffb0448009faf4bcc59336917'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.267223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b1bb4-f3ec-440e-a5f1-676bda2a649b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:42.272889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:42.273745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:42.274075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:42.274386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] PATH_INFO: `/v3/projects/70fe7f1988664f89958098f7ab928c5c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:42.275267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd14d306ffb0448009faf4bcc59336917'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.275581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=70fe7f1988664f89958098f7ab928c5c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:42.277492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:42.288024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:42.288175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd14d306ffb0448009faf4bcc59336917'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.302364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 944/1906] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:42 2022] DELETE /identity/v3/users/d14d306ffb0448009faf4bcc59336917 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:42.303819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:42.305301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:42.331181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70fe7f1988664f89958098f7ab928c5c', 'request_id': 'req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.338005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70fe7f1988664f89958098f7ab928c5c', 'request_id': 'req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.344209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70fe7f1988664f89958098f7ab928c5c', 'request_id': 'req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.358715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] The token cache is being invalidate because project 70fe7f1988664f89958098f7ab928c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:42.359099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.359748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57cb4fa9-8770-4ff9-9790-5fa87b0247ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.361685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 963/1907] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:42 2022] DELETE /identity/v3/projects/70fe7f1988664f89958098f7ab928c5c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:42.363346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:42.363346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:42.364051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:42.376271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22401-a948-455b-b5ca-de9872983c49 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:42.383252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:42.384552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:42.398854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:42.441398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:42.443419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:42.443419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:42.443419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] PATH_INFO: `/v3/users/ee5a3271cec946b6a71df589c39072d0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:42.444625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5a3271cec946b6a71df589c39072d0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:42.446640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:42.449987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 964/1908] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:42.450899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:42.452448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:42.487867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1d0f9-c744-4f6e-bcc2-d78b0e6d6580 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:42.494637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:42.495721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:42.496113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:42.496502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] PATH_INFO: `/v3/users/1b1dada7f2cc4a0383500d31f3567bc4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:42.497962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1dada7f2cc4a0383500d31f3567bc4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:42.500699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:42.514252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5a3271cec946b6a71df589c39072d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.515066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5a3271cec946b6a71df589c39072d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.515938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5a3271cec946b6a71df589c39072d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.525271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5a3271cec946b6a71df589c39072d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.543337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5a3271cec946b6a71df589c39072d0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.567396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1dada7f2cc4a0383500d31f3567bc4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.580479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1dada7f2cc4a0383500d31f3567bc4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.581244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1dada7f2cc4a0383500d31f3567bc4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.593677 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 945/1909] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:42 2022] DELETE /identity/v3/users/ee5a3271cec946b6a71df589c39072d0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:42.594781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:42.609048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:42.611505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1dada7f2cc4a0383500d31f3567bc4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.612743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1dada7f2cc4a0383500d31f3567bc4'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:42.665054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 965/1910] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:42 2022] DELETE /identity/v3/users/1b1dada7f2cc4a0383500d31f3567bc4 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:42.764530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370d258-fcd0-4c31-ad5a-c88a90c28644 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:42.900229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5407d14-c03e-4f24-9df0-59adfd695db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:42.900929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407d14-c03e-4f24-9df0-59adfd695db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:42.901655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407d14-c03e-4f24-9df0-59adfd695db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:42.901944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5407d14-c03e-4f24-9df0-59adfd695db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:42.903935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f5407d14-c03e-4f24-9df0-59adfd695db7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:42.936596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:43.003404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5407d14-c03e-4f24-9df0-59adfd695db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:43.005763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5407d14-c03e-4f24-9df0-59adfd695db7 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:43.017638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 946/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:43.149816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:43.151544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.177324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826934-a78e-4ba4-8127-3ce45344a0ff admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:43.189454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:43.191144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.193940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.194943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] PATH_INFO: `/v3/users/f7b1fc965d374a31b4787b57e757ea10` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.198697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b1fc965d374a31b4787b57e757ea10)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:43.208614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:43.220475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:43.324116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b1fc965d374a31b4787b57e757ea10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.335416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b1fc965d374a31b4787b57e757ea10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.336135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b1fc965d374a31b4787b57e757ea10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.352971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b1fc965d374a31b4787b57e757ea10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.353961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b1fc965d374a31b4787b57e757ea10'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.387314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 966/1912] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:43 2022] DELETE /identity/v3/users/f7b1fc965d374a31b4787b57e757ea10 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:43.389914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.390374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.390709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.417645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:43.421585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.506863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:43.508599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.538972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 947/1913] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:43.540586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:43.543278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.592513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b03554-5a6b-4ac3-94fb-65105b60526c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:43.599667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:43.601763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.602358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.602694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] PATH_INFO: `/v3/projects/f3b8538da6914d36ac8b7ada046bdf80` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.604598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b8538da6914d36ac8b7ada046bdf80)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:43.605001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605769f-a0f8-4c6b-bac4-892f2acbb996 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:43.606587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:43.616266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:43.617238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.617529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.617814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] PATH_INFO: `/v3/projects/39faaea721d748e49634fc791854535a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.619192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39faaea721d748e49634fc791854535a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:43.627171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:43.675686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b8538da6914d36ac8b7ada046bdf80', 'request_id': 'req-6f3de803-13dd-4c28-b26d-45dd86bace39'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.688036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b8538da6914d36ac8b7ada046bdf80', 'request_id': 'req-6f3de803-13dd-4c28-b26d-45dd86bace39'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.692806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39faaea721d748e49634fc791854535a', 'request_id': 'req-9d508175-db52-49c8-b40b-bc25f7c5a170'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.700944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b8538da6914d36ac8b7ada046bdf80', 'request_id': 'req-6f3de803-13dd-4c28-b26d-45dd86bace39'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.704862 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39faaea721d748e49634fc791854535a', 'request_id': 'req-9d508175-db52-49c8-b40b-bc25f7c5a170'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.723699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39faaea721d748e49634fc791854535a', 'request_id': 'req-9d508175-db52-49c8-b40b-bc25f7c5a170'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.725340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] The token cache is being invalidate because project f3b8538da6914d36ac8b7ada046bdf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:43.725696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.726478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.728408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 948/1914] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:43 2022] DELETE /identity/v3/projects/f3b8538da6914d36ac8b7ada046bdf80 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:43.729602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:43.730772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.748383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] The token cache is being invalidate because project 39faaea721d748e49634fc791854535a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:43.748634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.751323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.753140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 967/1915] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:43 2022] DELETE /identity/v3/projects/39faaea721d748e49634fc791854535a => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:43.758502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:43.758502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.779112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:43.780362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:43.806656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3de803-13dd-4c28-b26d-45dd86bace39 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:43.836223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d508175-db52-49c8-b40b-bc25f7c5a170 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:43.841652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:43.842558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.842878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.843171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] PATH_INFO: `/v3/projects/49a9f71c20b44d9b948aa7dc0c808b61` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.844446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] RBAC: Authorizing `identity:delete_project(project_id=49a9f71c20b44d9b948aa7dc0c808b61)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:43.846377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:43.858779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a6cf4-cff8-4dfa-9b33-a0ee90fc9cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:43.859556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6cf4-cff8-4dfa-9b33-a0ee90fc9cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.859940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6cf4-cff8-4dfa-9b33-a0ee90fc9cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.860274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6cf4-cff8-4dfa-9b33-a0ee90fc9cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.862225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-116a6cf4-cff8-4dfa-9b33-a0ee90fc9cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.876303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6cf4-cff8-4dfa-9b33-a0ee90fc9cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:43.877761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116a6cf4-cff8-4dfa-9b33-a0ee90fc9cc0 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:43.888399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 949/1916] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:43.889870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.890170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.890453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.895056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49a9f71c20b44d9b948aa7dc0c808b61', 'request_id': 'req-d0f508c5-e454-4908-8837-0ad48a60e32e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.900982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49a9f71c20b44d9b948aa7dc0c808b61', 'request_id': 'req-d0f508c5-e454-4908-8837-0ad48a60e32e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.907798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49a9f71c20b44d9b948aa7dc0c808b61', 'request_id': 'req-d0f508c5-e454-4908-8837-0ad48a60e32e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.909813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:43.911379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.921311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] The token cache is being invalidate because project 49a9f71c20b44d9b948aa7dc0c808b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:43.921600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.922259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d0f508c5-e454-4908-8837-0ad48a60e32e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:43.923881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 968/1917] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:43 2022] DELETE /identity/v3/projects/49a9f71c20b44d9b948aa7dc0c808b61 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:43.925281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef919a-28b9-4bd8-963a-b0362b7098dd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:43.925574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef919a-28b9-4bd8-963a-b0362b7098dd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:43.926439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef919a-28b9-4bd8-963a-b0362b7098dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:43.947595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-31ef919a-28b9-4bd8-963a-b0362b7098dd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:43.948830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-31ef919a-28b9-4bd8-963a-b0362b7098dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:43.986082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 950/1918] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:43.986082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:43.988069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:44.002096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bb255c-a0ab-4cf4-99ee-5cb66fc2a558 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:44.011476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:44.018633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.018922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.019218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] PATH_INFO: `/v3/users/408ff3bb84754f5fa8e7d8de272674c1` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.021611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=408ff3bb84754f5fa8e7d8de272674c1)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:44.031034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:44.046352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 969/1919] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:44.048560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc57d15-8c67-4fc4-ad20-031568b64261 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.049370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc57d15-8c67-4fc4-ad20-031568b64261 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.049716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc57d15-8c67-4fc4-ad20-031568b64261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.081173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-bbc57d15-8c67-4fc4-ad20-031568b64261 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:44.083605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bbc57d15-8c67-4fc4-ad20-031568b64261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:44.095820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 970/1920] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:44.097198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e4693-89da-4ef8-bf23-3e6f96418fa1 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.097556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e4693-89da-4ef8-bf23-3e6f96418fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.098466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1e4693-89da-4ef8-bf23-3e6f96418fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.121122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dd1e4693-89da-4ef8-bf23-3e6f96418fa1 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:44.122553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dd1e4693-89da-4ef8-bf23-3e6f96418fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:44.141061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 971/1921] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:44.141061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e4693-89da-4ef8-bf23-3e6f96418fa1 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:44.141372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408ff3bb84754f5fa8e7d8de272674c1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.141884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408ff3bb84754f5fa8e7d8de272674c1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.142609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408ff3bb84754f5fa8e7d8de272674c1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.151211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1e4693-89da-4ef8-bf23-3e6f96418fa1 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:44.151921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408ff3bb84754f5fa8e7d8de272674c1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.157291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:44.158557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.159697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.159996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.161757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:44.162121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:44.164201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:44.173234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408ff3bb84754f5fa8e7d8de272674c1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.179829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 972/1922] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:44.180035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:44.182133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:44.193443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 951/1923] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:43 2022] DELETE /identity/v3/users/408ff3bb84754f5fa8e7d8de272674c1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:44.196558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:44.197806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:44.211892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250500c-a869-4108-b4f3-a7fd7e244117 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:44.223570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:44.245148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:44.374169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:44.376258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc9d3f-2be1-4f73-b466-f2a921bcc35c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:44.377481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.377997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.378549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.380727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:44.382153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:44.385042 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:44.392041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:44.393297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.393708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.394137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.395565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:44.398461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:44.413353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 973/1924] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:44.414485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:44.417123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:44.465153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 952/1925] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:44 2022] POST /identity/v3/projects => generated 381 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:44.469627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:44.470228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1317bea-edf7-4c3a-8368-7590e0df649b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:44.668276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:44.669413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.674067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.674767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] PATH_INFO: `/v3/projects/30ca7847dd7b4940b6e98fa5788f9900` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.678351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ca7847dd7b4940b6e98fa5788f9900)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:44.683673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:44.694418 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7debf9-a82a-4787-92b0-daa7e8b7eba5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:44.713669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:44.715095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:44.715901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:44.717702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:44.718514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:44.726135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:44.786801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 953/1926] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:44 2022] POST /identity/v3/projects => generated 409 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:44.804520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:44.828186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ca7847dd7b4940b6e98fa5788f9900', 'request_id': 'req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.842329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ca7847dd7b4940b6e98fa5788f9900', 'request_id': 'req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.853645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ca7847dd7b4940b6e98fa5788f9900', 'request_id': 'req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.893196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] The token cache is being invalidate because project 30ca7847dd7b4940b6e98fa5788f9900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:44.893540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.894293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:44.899583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 974/1927] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:44 2022] DELETE /identity/v3/projects/30ca7847dd7b4940b6e98fa5788f9900 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:44.900473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:44.905431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:44.962426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480580ad-8ddb-4ff7-864e-c6edbc81ac9a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.009266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:45.009976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:45.055817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efe8ba-a8c4-41e5-a614-fdf2048fa694 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.066722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.067456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.067745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.068022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.069093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.071185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.102880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 975/1928] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:44 2022] POST /identity/v3/users => generated 305 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:45.105861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.107999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.108522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.108804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.109086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.109812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.112428 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.120953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.134431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8db3b2-4df0-449d-b9c6-4f27550e8d76 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.141494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.143386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.143685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.144007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] PATH_INFO: `/v3/projects/608d5b2d1c34470392be1a19f6bdced2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.145895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=608d5b2d1c34470392be1a19f6bdced2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.148147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.173023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 954/1929] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:44 2022] POST /identity/v3/users => generated 291 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:45.173023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.173023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.195138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dde5a-8529-47b7-9180-687401a57a51 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.200354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.201251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.201540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.201822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] PATH_INFO: `/v3/users/46935a554623446bbe97c5a7a980c638` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.203200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46935a554623446bbe97c5a7a980c638)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.205589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.233978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '608d5b2d1c34470392be1a19f6bdced2', 'request_id': 'req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.244096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '608d5b2d1c34470392be1a19f6bdced2', 'request_id': 'req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.256110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '608d5b2d1c34470392be1a19f6bdced2', 'request_id': 'req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.288549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] The token cache is being invalidate because project 608d5b2d1c34470392be1a19f6bdced2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:45.288848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.289555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.291792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 976/1930] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:45 2022] DELETE /identity/v3/projects/608d5b2d1c34470392be1a19f6bdced2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:45.292649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.294277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.306730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46935a554623446bbe97c5a7a980c638'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.308248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46935a554623446bbe97c5a7a980c638'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.311264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46935a554623446bbe97c5a7a980c638'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.321001 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46935a554623446bbe97c5a7a980c638'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.337957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46935a554623446bbe97c5a7a980c638'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:45.353014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 955/1931] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:45 2022] DELETE /identity/v3/users/46935a554623446bbe97c5a7a980c638 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:45.353807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.355664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.399528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec3ac6-a1ce-4e6c-8693-f12dc6df20bb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.454807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1756c-b3ea-4e9a-ae6f-d55e7c538a84 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.469331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a46efe-ea74-42ca-ad96-e9899be4994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.471236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a46efe-ea74-42ca-ad96-e9899be4994f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.471451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a46efe-ea74-42ca-ad96-e9899be4994f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.471733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a46efe-ea74-42ca-ad96-e9899be4994f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.472489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a46efe-ea74-42ca-ad96-e9899be4994f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.474712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a46efe-ea74-42ca-ad96-e9899be4994f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.503864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 956/1932] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:45.505550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6494-0f08-4850-bb55-9c654735e0aa None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.505959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6494-0f08-4850-bb55-9c654735e0aa None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.506221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa6494-0f08-4850-bb55-9c654735e0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.526412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fbd6d-d5e6-4664-a747-ce5b133eebe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.532278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fbd6d-d5e6-4664-a747-ce5b133eebe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.532582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fbd6d-d5e6-4664-a747-ce5b133eebe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.532869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fbd6d-d5e6-4664-a747-ce5b133eebe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.533657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fbd6d-d5e6-4664-a747-ce5b133eebe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.533824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5baa6494-0f08-4850-bb55-9c654735e0aa None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:45.536924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5baa6494-0f08-4850-bb55-9c654735e0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.539327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fbd6d-d5e6-4664-a747-ce5b133eebe1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.543838 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:45.546246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 957/1933] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:45.548099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6494-0f08-4850-bb55-9c654735e0aa None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.569237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa6494-0f08-4850-bb55-9c654735e0aa None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.573340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 977/1934] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:45.575372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.576370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.576686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.581048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.581746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.582033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.583219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.584537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.586971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.604895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:45.606166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.617774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 978/1935] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:45.622459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 958/1936] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:45.622608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.623353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.628063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.639020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:45.650760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b602ff-5805-4196-b861-efbebca4851f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.657239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.658057 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.658492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.658913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.659794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:45.660238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.661639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896fdda-21e5-4b2b-9a13-5ee7cfe3cd54 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.663014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.669318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.670010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.670294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.671095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.672865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.675451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.677361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 959/1937] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:45.678370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.695143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 979/1938] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:45.696855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcacd78-180d-47a6-a0b1-02f5af4313aa admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.700947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.705480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.706569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.706690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.706981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] PATH_INFO: `/v3/projects/73255e4ad1254df4b93d3af78c4e5b13/users/ed4be6bcb36d49a5affcf23b22d14610/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.718765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cea9-a863-4b95-9c18-99c44859948c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.725929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73255e4ad1254df4b93d3af78c4e5b13, user_id=ed4be6bcb36d49a5affcf23b22d14610, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.726645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd2db83-0c76-4e06-8143-e37a776b20dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.727387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2db83-0c76-4e06-8143-e37a776b20dd admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.727770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2db83-0c76-4e06-8143-e37a776b20dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.728168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2db83-0c76-4e06-8143-e37a776b20dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.729991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.732820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2db83-0c76-4e06-8143-e37a776b20dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.737057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd2db83-0c76-4e06-8143-e37a776b20dd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.755798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 960/1939] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:45 2022] PUT /identity/v3/projects/73255e4ad1254df4b93d3af78c4e5b13/users/ed4be6bcb36d49a5affcf23b22d14610/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:45.756637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.803516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 980/1940] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:45 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:45.803516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.803516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.803516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.841692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] MFA Rules not processed for user `ed4be6bcb36d49a5affcf23b22d14610`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:45.843132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.859996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0433a4c-612e-4ab0-8eb5-6f9c485e2011 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:45.913894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 981/1941] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:45.914669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:45.916064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:45.934161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:45.935111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:45.935394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:45.935672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] PATH_INFO: `/v3/projects/596045b5716e4a2b820b5182cdb9fc86/users/6dad23eb5f184d60acd8388cb67400b7/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:45.952911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=596045b5716e4a2b820b5182cdb9fc86, user_id=6dad23eb5f184d60acd8388cb67400b7, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:45.955795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:45.972357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 961/1942] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:45 2022] PUT /identity/v3/projects/596045b5716e4a2b820b5182cdb9fc86/users/6dad23eb5f184d60acd8388cb67400b7/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:45.973155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.000138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99365b0-e2ac-4b3d-9ba3-0847aaa80258 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.040340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:46.045675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222d430-2233-4332-86c5-92456c4b3a2b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.054823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.055536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.055821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.056097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.056788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.063480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.071787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:46.081547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.083469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.084235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.085372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] PATH_INFO: `/v3/projects/e064be588c3948a38e56ba0d61556459` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.087462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e064be588c3948a38e56ba0d61556459)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.089301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.095901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 962/1943] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:45 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:46.096744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.115760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d874caa-2e58-468b-8fed-615b01b6e49a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.124355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58bc7c-97ad-4146-a076-72033a54b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.125212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58bc7c-97ad-4146-a076-72033a54b1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.125748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58bc7c-97ad-4146-a076-72033a54b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.125946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58bc7c-97ad-4146-a076-72033a54b1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.126652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58bc7c-97ad-4146-a076-72033a54b1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.128811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58bc7c-97ad-4146-a076-72033a54b1ba admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.149205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e064be588c3948a38e56ba0d61556459', 'request_id': 'req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:46.157931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e064be588c3948a38e56ba0d61556459', 'request_id': 'req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:46.167681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e064be588c3948a38e56ba0d61556459', 'request_id': 'req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:46.174812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 963/1944] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:46.177190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.179170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.179611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.185399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] The token cache is being invalidate because project e064be588c3948a38e56ba0d61556459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:46.185693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:46.186459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:46.188395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 982/1945] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:45 2022] DELETE /identity/v3/projects/e064be588c3948a38e56ba0d61556459 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:46.189032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.190434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:46.230198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] MFA Rules not processed for user `6dad23eb5f184d60acd8388cb67400b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:46.232010 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:46.275094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02b0b6-0a69-46b5-9eb8-7b14a0565c67 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.344687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 964/1946] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:46.345592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.349903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:46.398039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf43c2-2ca5-464c-b274-0ad1145b6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.398920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf43c2-2ca5-464c-b274-0ad1145b6cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.399386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf43c2-2ca5-464c-b274-0ad1145b6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.399605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf43c2-2ca5-464c-b274-0ad1145b6cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.400409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf43c2-2ca5-464c-b274-0ad1145b6cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.402974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf43c2-2ca5-464c-b274-0ad1145b6cdb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.424192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 983/1947] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:46.424192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.424442 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.425040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.449329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c387f9-c94c-46f0-baca-52efdf2c00e5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.449616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:46.451147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:46.456213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.456968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.457546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.458161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.459835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.463484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.465165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 984/1948] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:46.467726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.480441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:46.495187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae743ef-079c-477a-9a53-ce198d7e6243 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.500461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da90eb-e5db-46da-b280-4ae85ce390df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.501233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da90eb-e5db-46da-b280-4ae85ce390df admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.501578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da90eb-e5db-46da-b280-4ae85ce390df admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.506499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da90eb-e5db-46da-b280-4ae85ce390df admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.506625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 965/1949] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:46.506738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da90eb-e5db-46da-b280-4ae85ce390df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.506810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.506992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da90eb-e5db-46da-b280-4ae85ce390df admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.531996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24150b0-7153-44a5-8a4c-72b18e7a5cb8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.532641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:46.550531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.554690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.555039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.555333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.556187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.558718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.582993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 985/1950] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/projects => generated 409 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:46.590413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc23e-9d5e-455f-82ac-77d290a5469f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.598523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc23e-9d5e-455f-82ac-77d290a5469f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.600248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cc23e-9d5e-455f-82ac-77d290a5469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.601443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 966/1951] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:46.602379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.636511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b94f35-e5cc-4ff4-bc57-87d19d3a8f30 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.643078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9d9cc23e-9d5e-455f-82ac-77d290a5469f None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:46.650298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9d9cc23e-9d5e-455f-82ac-77d290a5469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:46.710434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:46.736223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 986/1952] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:46.737130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc23e-9d5e-455f-82ac-77d290a5469f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.748568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.749334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.749617 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.749890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.750624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.750901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cc23e-9d5e-455f-82ac-77d290a5469f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.752273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.756441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.757174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.757508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.757844 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.758660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.761325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.765671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 967/1953] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:46.766515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.777741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1f510-7e36-4426-8f77-dc8aac3648bb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.783995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.784885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.785691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.785977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] PATH_INFO: `/v3/projects/2112e2a0ccaa44a4a8ee4157e9051b7d/users/ce4aa071787f4a3f8a3e079e647d67f6/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.790877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 987/1954] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/users => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:46.790877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.800898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a3189-0750-401d-89f4-ecbd6412f7ed admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.803095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2112e2a0ccaa44a4a8ee4157e9051b7d, user_id=ce4aa071787f4a3f8a3e079e647d67f6, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.805815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.808548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.809298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.809588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.809894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.810623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:46.811064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.812653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.820605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 968/1955] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:46 2022] PUT /identity/v3/projects/2112e2a0ccaa44a4a8ee4157e9051b7d/users/ce4aa071787f4a3f8a3e079e647d67f6/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:46.823623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.826931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 988/1956] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:46.827986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.841419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afe18a3-6cb6-4cdd-96f4-f1389763abc0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.902227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca66aec-a9e5-429f-a212-078af01e75ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.902380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556f144-e9a6-4e16-b238-027f60aacd39 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:46.903411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66aec-a9e5-429f-a212-078af01e75ba admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.903818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66aec-a9e5-429f-a212-078af01e75ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.904199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca66aec-a9e5-429f-a212-078af01e75ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.905061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca66aec-a9e5-429f-a212-078af01e75ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.906782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca66aec-a9e5-429f-a212-078af01e75ba admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.907553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:46.909618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.909907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.910743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] PATH_INFO: `/v3/projects/1b9ab0adadad432b828aef1beb105b24/users/7a1393e0618c40eabce4364feb696fdf/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.921955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 989/1957] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:46.921955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c0f9-6c77-448d-92b8-f397f93b21d4 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:46.921955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c0f9-6c77-448d-92b8-f397f93b21d4 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:46.921955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633c0f9-6c77-448d-92b8-f397f93b21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:46.931191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9ab0adadad432b828aef1beb105b24, user_id=7a1393e0618c40eabce4364feb696fdf, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:46.934200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:46.947954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 969/1958] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:46 2022] PUT /identity/v3/projects/1b9ab0adadad432b828aef1beb105b24/users/7a1393e0618c40eabce4364feb696fdf/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:46.949055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:46.955746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d633c0f9-6c77-448d-92b8-f397f93b21d4 None None] MFA Rules not processed for user `ce4aa071787f4a3f8a3e079e647d67f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:46.956976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d633c0f9-6c77-448d-92b8-f397f93b21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:47.021352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:47.022545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfffd-eb9e-480e-8278-66de428d5c97 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.029652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.030534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.031026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.031456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.032303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.032923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 990/1959] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:47.034652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.038096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633c0f9-6c77-448d-92b8-f397f93b21d4 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.065613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633c0f9-6c77-448d-92b8-f397f93b21d4 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.069996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 970/1960] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:46 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:47.070867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.075208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.076110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.076389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.076697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] PATH_INFO: `/v3/projects/e9a208f22d6a471d9ff773383458cb99/users/593107c857f54d69be7d7982dc0eacd8/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.087179 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:47.094350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a208f22d6a471d9ff773383458cb99, user_id=593107c857f54d69be7d7982dc0eacd8, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.097034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.112447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 991/1961] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:47 2022] PUT /identity/v3/projects/e9a208f22d6a471d9ff773383458cb99/users/593107c857f54d69be7d7982dc0eacd8/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:47.113684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.148759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7387b57-cd36-40b7-ae75-5c0d48a8acdc admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.190314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de092fe-4b0c-48ce-8396-94f20872dcce admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.196118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.196638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.196986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.197275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.198076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.200083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.214458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.215217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.215512 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.215793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.216945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.218219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.229668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 971/1962] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:47.230528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.238404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 992/1963] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:47 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:47.239837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.244054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc29e9-8b97-41ce-b403-5b0eee3891b5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.315477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.316176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.316322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8100-fb3e-4c73-8c1f-07bc96b6bc83 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.317296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.317481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.318247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.320309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.321818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.322522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.323031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.323312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.324041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.325632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.337799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 993/1964] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:47.338660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.344958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 972/1965] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:47 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:47.346094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.352063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd02b-4282-4a65-bd6d-f411bf36b31e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.356884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.357555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bf985e-cce3-4095-a513-481d20d79dc6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.357781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.358113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.358392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] PATH_INFO: `/v3/projects/1b9ab0adadad432b828aef1beb105b24/users/7a1393e0618c40eabce4364feb696fdf/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.361933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9ab0adadad432b828aef1beb105b24, user_id=7a1393e0618c40eabce4364feb696fdf, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.364266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.364641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.364764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.365047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.365396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.366155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.368233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.390762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 994/1966] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:47 2022] PUT /identity/v3/projects/1b9ab0adadad432b828aef1beb105b24/users/7a1393e0618c40eabce4364feb696fdf/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:47.391902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.404758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 973/1967] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:47 2022] POST /identity/v3/users => generated 290 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:47.409265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.421993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d640d1-25a2-4bae-97e9-d20602c35ba5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.450710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:47.452559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:47.477523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651fe91-aa78-451c-8b67-0e7b3d954aba admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.483231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.484386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.485173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.485933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] PATH_INFO: `/v3/projects/e9a208f22d6a471d9ff773383458cb99/users/593107c857f54d69be7d7982dc0eacd8/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.487893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a208f22d6a471d9ff773383458cb99, user_id=593107c857f54d69be7d7982dc0eacd8, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.489287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879dea4-a819-49e8-97f6-4e3b0cd17793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.490136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879dea4-a819-49e8-97f6-4e3b0cd17793 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.490526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879dea4-a819-49e8-97f6-4e3b0cd17793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.491114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.491232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879dea4-a819-49e8-97f6-4e3b0cd17793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.491912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879dea4-a819-49e8-97f6-4e3b0cd17793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.493678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879dea4-a819-49e8-97f6-4e3b0cd17793 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.506517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 974/1968] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:47.508101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5387ae4-b504-43bf-8ecf-34a1b6e5dbe6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.508532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5387ae4-b504-43bf-8ecf-34a1b6e5dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.509135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5387ae4-b504-43bf-8ecf-34a1b6e5dbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.528542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 995/1969] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:47 2022] PUT /identity/v3/projects/e9a208f22d6a471d9ff773383458cb99/users/593107c857f54d69be7d7982dc0eacd8/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:47.532123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.541483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e5387ae4-b504-43bf-8ecf-34a1b6e5dbe6 None None] MFA Rules not processed for user `7a1393e0618c40eabce4364feb696fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:47.543096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e5387ae4-b504-43bf-8ecf-34a1b6e5dbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:47.651953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b579be-e59c-42bd-858d-112130a20528 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.660704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83477e96-741b-47d3-a36e-0434f7924fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.661883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83477e96-741b-47d3-a36e-0434f7924fef admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.663314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83477e96-741b-47d3-a36e-0434f7924fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.663601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83477e96-741b-47d3-a36e-0434f7924fef admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.664411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83477e96-741b-47d3-a36e-0434f7924fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.666144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83477e96-741b-47d3-a36e-0434f7924fef admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.671737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 975/1970] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:47.672916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5387ae4-b504-43bf-8ecf-34a1b6e5dbe6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.686706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 996/1971] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:47.688243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17335e2-5893-47b7-9c59-bd601d3aec69 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.688675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17335e2-5893-47b7-9c59-bd601d3aec69 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.689004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17335e2-5893-47b7-9c59-bd601d3aec69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.689846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5387ae4-b504-43bf-8ecf-34a1b6e5dbe6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.699522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.700643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.701032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.701537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.702632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.705800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.721865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b17335e2-5893-47b7-9c59-bd601d3aec69 None None] MFA Rules not processed for user `593107c857f54d69be7d7982dc0eacd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:47.723260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b17335e2-5893-47b7-9c59-bd601d3aec69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:47.737315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 976/1972] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:47.741330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.747528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:47.827568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 997/1973] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:47 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:47.827568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17335e2-5893-47b7-9c59-bd601d3aec69 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.835434 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17335e2-5893-47b7-9c59-bd601d3aec69 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.840468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.841377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.841665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.841944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] PATH_INFO: `/v3/projects/661d0605098e4014a73d8faadb0bb9e4/users/17123472e57c4547ab6ddf0e9ec72d16/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:47.859321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=661d0605098e4014a73d8faadb0bb9e4, user_id=17123472e57c4547ab6ddf0e9ec72d16, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:47.862157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:47.895605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 998/1974] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:47 2022] PUT /identity/v3/projects/661d0605098e4014a73d8faadb0bb9e4/users/17123472e57c4547ab6ddf0e9ec72d16/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:47.896554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:47.916244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76324f-8a19-429e-a056-504ba08714e1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:47.978623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:47.994803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:47.995501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:47.996078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:47.996362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.003780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:48.017473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381a132-2736-47a5-a6ea-1a22cc059617 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:48.022682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:48.023825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.024212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.024592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] PATH_INFO: `/v3/projects/42e2eb92df4742388b550a9d8102c4d4/users/fcbb043f3a9c4dd882ec223ce1a2db4b/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.041175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e2eb92df4742388b550a9d8102c4d4, user_id=fcbb043f3a9c4dd882ec223ce1a2db4b, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.043999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.067001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 999/1975] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:47 2022] PUT /identity/v3/projects/42e2eb92df4742388b550a9d8102c4d4/users/fcbb043f3a9c4dd882ec223ce1a2db4b/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:48.067001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:48.071330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:48.083754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.085114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.098787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 977/1976] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:48.100051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:48.114579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188de99-9c0d-4754-aa16-e47ac6104697 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:48.164503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe54b05-87e6-47a8-8267-d7d6eae31676 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:48.170306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:48.171342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.172070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.172455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.194473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfb93a-aa52-4019-8ac1-3ee8c14b1552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:48.195186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfb93a-aa52-4019-8ac1-3ee8c14b1552 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.195470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfb93a-aa52-4019-8ac1-3ee8c14b1552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.195745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfb93a-aa52-4019-8ac1-3ee8c14b1552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.196653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfb93a-aa52-4019-8ac1-3ee8c14b1552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.198068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfb93a-aa52-4019-8ac1-3ee8c14b1552 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.208707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 978/1977] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:48.213184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919054e-bdb1-433c-8e4e-daa728a9d89b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.213465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919054e-bdb1-433c-8e4e-daa728a9d89b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.213744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0919054e-bdb1-433c-8e4e-daa728a9d89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.243682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0919054e-bdb1-433c-8e4e-daa728a9d89b None None] MFA Rules not processed for user `fcbb043f3a9c4dd882ec223ce1a2db4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:48.244895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0919054e-bdb1-433c-8e4e-daa728a9d89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:48.259990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.267056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.281752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1000/1978] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:48.282824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:48.296854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4531342-6b90-4e06-902d-137cbb7fcc10 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:48.304015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d612f-4629-42a1-91cd-7af41c0255ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:48.305809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d612f-4629-42a1-91cd-7af41c0255ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.308169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d612f-4629-42a1-91cd-7af41c0255ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.309162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d612f-4629-42a1-91cd-7af41c0255ba admin admin] PATH_INFO: `/v3/projects/661d0605098e4014a73d8faadb0bb9e4/users/17123472e57c4547ab6ddf0e9ec72d16/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.311607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d612f-4629-42a1-91cd-7af41c0255ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=661d0605098e4014a73d8faadb0bb9e4, user_id=17123472e57c4547ab6ddf0e9ec72d16, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.315788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d612f-4629-42a1-91cd-7af41c0255ba admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.329513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1001/1979] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:48 2022] PUT /identity/v3/projects/661d0605098e4014a73d8faadb0bb9e4/users/17123472e57c4547ab6ddf0e9ec72d16/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:48.339972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 979/1980] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:48.342014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251cc98-2523-49c9-abd6-ef9e4994922c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.342405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251cc98-2523-49c9-abd6-ef9e4994922c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.343069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251cc98-2523-49c9-abd6-ef9e4994922c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.400513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919054e-bdb1-433c-8e4e-daa728a9d89b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:48.409212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3251cc98-2523-49c9-abd6-ef9e4994922c None None] MFA Rules not processed for user `17123472e57c4547ab6ddf0e9ec72d16`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:48.412135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3251cc98-2523-49c9-abd6-ef9e4994922c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:48.426539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0919054e-bdb1-433c-8e4e-daa728a9d89b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:48.479280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:48.484427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:48.518697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:48.520397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.520397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.520783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.521585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1002/1981] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:48 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:48.595875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.596029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.606536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 980/1982] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:48.678542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251cc98-2523-49c9-abd6-ef9e4994922c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:48.689201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251cc98-2523-49c9-abd6-ef9e4994922c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:48.693722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:48.694375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.694731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.695110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.705600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.707699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.726948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1003/1983] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:48 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:48.763618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:48.774640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32044ef1-c32a-428b-8649-52598808c244 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:48.779124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:48.779791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:48.780731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:48.780864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:48.853383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:48.855012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:48.864885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 981/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:49.092870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:49.101928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b523a-da44-4247-95ca-8cd620f78b21 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:49.106302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d5f78-65b1-4c82-807d-b8746839a2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:49.106893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d5f78-65b1-4c82-807d-b8746839a2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:49.107263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d5f78-65b1-4c82-807d-b8746839a2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:49.107612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d5f78-65b1-4c82-807d-b8746839a2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:49.222779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d5f78-65b1-4c82-807d-b8746839a2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:49.224516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d5f78-65b1-4c82-807d-b8746839a2b5 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:49.240571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1004/1985] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:49.667522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:49.752013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a24469-2f0f-42a3-9bbb-a8ea1896805d service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:49.757364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:49.758320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:49.758608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:49.758915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] PATH_INFO: `/v3/users/ed4be6bcb36d49a5affcf23b22d14610` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:49.760141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed4be6bcb36d49a5affcf23b22d14610)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:49.762207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:49.789589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:49.818655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed4be6bcb36d49a5affcf23b22d14610'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:49.819335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed4be6bcb36d49a5affcf23b22d14610'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:49.819943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed4be6bcb36d49a5affcf23b22d14610'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:49.827810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed4be6bcb36d49a5affcf23b22d14610'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:49.843360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed4be6bcb36d49a5affcf23b22d14610'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:49.856762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 982/1986] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:49 2022] DELETE /identity/v3/users/ed4be6bcb36d49a5affcf23b22d14610 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:49.861252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:49.861717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:49.861833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:49.880365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:49.881947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:49.948072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1005/1987] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:49.958584 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:49.960163 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:50.017246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859017f1-c6f8-4c19-8079-dfca6057fffe admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:50.021387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:50.022054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:50.022340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:50.022613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:50.031474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:50.032899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:50.042612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 983/1988] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:50.328732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:50.330333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:50.344683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba426097-5f3a-486b-b43f-d988bc61ed5c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:50.349487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:50.350399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:50.350679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:50.350989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] PATH_INFO: `/v3/projects/73255e4ad1254df4b93d3af78c4e5b13` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:50.352187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73255e4ad1254df4b93d3af78c4e5b13)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:50.354100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:50.406670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73255e4ad1254df4b93d3af78c4e5b13', 'request_id': 'req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.413007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:50.414759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73255e4ad1254df4b93d3af78c4e5b13', 'request_id': 'req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.422709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73255e4ad1254df4b93d3af78c4e5b13', 'request_id': 'req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.437123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] The token cache is being invalidate because project 73255e4ad1254df4b93d3af78c4e5b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:50.437457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.438255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.440131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1006/1989] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:50 2022] DELETE /identity/v3/projects/73255e4ad1254df4b93d3af78c4e5b13 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:50.445040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:50.456381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6741147-15af-4040-bf02-65fa5727e291 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:50.530544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:50.531481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:50.531768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:50.532121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] PATH_INFO: `/v3/users/7a1393e0618c40eabce4364feb696fdf` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:50.533629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1393e0618c40eabce4364feb696fdf)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:50.535752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:50.646220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:50.649612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1393e0618c40eabce4364feb696fdf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.650605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1393e0618c40eabce4364feb696fdf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.651370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1393e0618c40eabce4364feb696fdf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.662953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1393e0618c40eabce4364feb696fdf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.680067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-91c4c1bc-8511-46d3-870a-acf63b986746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1393e0618c40eabce4364feb696fdf'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:50.706750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 984/1990] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:50 2022] DELETE /identity/v3/users/7a1393e0618c40eabce4364feb696fdf => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:51.233902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:51.236634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:51.252557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1705e8-c8f8-41ed-83e4-f8444a94b88f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:51.335446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:51.336957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.337315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.337729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] PATH_INFO: `/v3/projects/1b9ab0adadad432b828aef1beb105b24` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.339677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9ab0adadad432b828aef1beb105b24)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:51.341682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:51.401876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9ab0adadad432b828aef1beb105b24', 'request_id': 'req-74d4e4f2-ffc0-4843-a030-33ce58911dbd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:51.411996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9ab0adadad432b828aef1beb105b24', 'request_id': 'req-74d4e4f2-ffc0-4843-a030-33ce58911dbd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:51.419456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9ab0adadad432b828aef1beb105b24', 'request_id': 'req-74d4e4f2-ffc0-4843-a030-33ce58911dbd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:51.435422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] The token cache is being invalidate because project 1b9ab0adadad432b828aef1beb105b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:51.436613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:51.437421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-74d4e4f2-ffc0-4843-a030-33ce58911dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:51.439472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1007/1991] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:51 2022] DELETE /identity/v3/projects/1b9ab0adadad432b828aef1beb105b24 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:51.444370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0408d75-800a-406e-951d-f77b7402bbfb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.444655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0408d75-800a-406e-951d-f77b7402bbfb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.444936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0408d75-800a-406e-951d-f77b7402bbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.485953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f0408d75-800a-406e-951d-f77b7402bbfb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:51.487413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f0408d75-800a-406e-951d-f77b7402bbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:51.605556 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 985/1992] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:51.612846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570668-033a-4a9b-a9ee-194e28364160 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.613053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570668-033a-4a9b-a9ee-194e28364160 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.613359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4570668-033a-4a9b-a9ee-194e28364160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.647772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f4570668-033a-4a9b-a9ee-194e28364160 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:51.649532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f4570668-033a-4a9b-a9ee-194e28364160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:51.662689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1008/1993] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:51.667384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0408d75-800a-406e-951d-f77b7402bbfb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:51.677954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0408d75-800a-406e-951d-f77b7402bbfb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:51.683663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:51.684976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.685439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.685865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.686756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:51.687234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:51.689011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:51.702105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 986/1994] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:51.706441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4570668-033a-4a9b-a9ee-194e28364160 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:51.718535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4570668-033a-4a9b-a9ee-194e28364160 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:51.726550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:51.727267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.727548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.727994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.728739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:51.730981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:51.779972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1009/1995] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:51 2022] POST /identity/v3/projects => generated 383 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:51.784157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:51.794907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f4dd3-fb78-4c5e-997e-8e3ff2aa4b67 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:51.883997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:51.884687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.884976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.885257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.885970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:51.888253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:51.920321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 987/1996] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:51 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:51.924003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:51.935343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb1efe-1221-40d7-9d23-7061389b4237 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:51.942058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:51.942841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.943160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.943441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.944288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:51.946207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:51.959052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1010/1997] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:51.964949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:51.977397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f0d84-55e1-49e2-866f-99fa584d7b3d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:51.983352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890808e-8076-43f7-ac5e-0854c667eeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:51.984716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890808e-8076-43f7-ac5e-0854c667eeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:51.985156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890808e-8076-43f7-ac5e-0854c667eeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:51.985707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890808e-8076-43f7-ac5e-0854c667eeb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:51.987481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890808e-8076-43f7-ac5e-0854c667eeb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:51.989506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890808e-8076-43f7-ac5e-0854c667eeb1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.018014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 988/1998] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:52.023246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.043561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabf636-5779-4c86-ba06-96b5b0aff81c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:52.061975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:52.063224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.063496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.063767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] PATH_INFO: `/v3/projects/5c05bc563b954ae784a4771f3cc25364/users/ea483e5fa4a04445804be9aca56b0a61/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.102379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c05bc563b954ae784a4771f3cc25364, user_id=ea483e5fa4a04445804be9aca56b0a61, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:52.112177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.146206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1011/1999] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:52 2022] PUT /identity/v3/projects/5c05bc563b954ae784a4771f3cc25364/users/ea483e5fa4a04445804be9aca56b0a61/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:52.157132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e94fb-5a91-47ea-8be9-694c3f6def70 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.157672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e94fb-5a91-47ea-8be9-694c3f6def70 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.157994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544e94fb-5a91-47ea-8be9-694c3f6def70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.213720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-544e94fb-5a91-47ea-8be9-694c3f6def70 None None] MFA Rules not processed for user `ea483e5fa4a04445804be9aca56b0a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:52.215109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-544e94fb-5a91-47ea-8be9-694c3f6def70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:52.243286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:52.405241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 989/2000] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:52.410263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.429065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:52.499987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b2685-9381-4e05-8ac4-87e376984670 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:52.504722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:52.505703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.506064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.506379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.507280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:52.509616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.550261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1012/2001] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:52 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:52.554779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e94fb-5a91-47ea-8be9-694c3f6def70 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.570276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544e94fb-5a91-47ea-8be9-694c3f6def70 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:52.686410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:52.688113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.688564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.689030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.690552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:52.693030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.717609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 990/2002] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:52 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:52.721905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.736195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194828c8-e554-41b9-b01c-731cec0ba246 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:52.744224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:52.745233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.745724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.746218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.747249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:52.749969 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.761618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1013/2003] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:52.766184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.780840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d42b18-a6c8-443f-b860-5226fd32b414 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:52.791838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:52.793024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.793423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.793938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] PATH_INFO: `/v3/projects/ef4044fecaf144fb9765093dd35a7393/users/4eaea4edbdf1463b88da30b1c3387c29/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.819854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4044fecaf144fb9765093dd35a7393, user_id=4eaea4edbdf1463b88da30b1c3387c29, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:52.822743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.846100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 991/2004] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:52 2022] PUT /identity/v3/projects/ef4044fecaf144fb9765093dd35a7393/users/4eaea4edbdf1463b88da30b1c3387c29/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:52.850715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.863460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7b3df-1e8b-40dd-bc0f-c498332c4367 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:52.916116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.918348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:52.950504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:52.951134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.951418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.951700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.952432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:52.954029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.964626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1014/2005] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:52 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:52.968766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:52.980371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc4f25-b717-4dbf-b3d9-a226e07041d6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:52.985536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52128e11-bf46-4b5c-8961-204ed87b1072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:52.986445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128e11-bf46-4b5c-8961-204ed87b1072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:52.986726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128e11-bf46-4b5c-8961-204ed87b1072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:52.987045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52128e11-bf46-4b5c-8961-204ed87b1072 admin admin] PATH_INFO: `/v3/projects/ef4044fecaf144fb9765093dd35a7393/users/4eaea4edbdf1463b88da30b1c3387c29/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:52.989153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52128e11-bf46-4b5c-8961-204ed87b1072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4044fecaf144fb9765093dd35a7393, user_id=4eaea4edbdf1463b88da30b1c3387c29, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:52.992567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52128e11-bf46-4b5c-8961-204ed87b1072 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:52.995279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97640a94-07cc-4f00-9284-8ef2b6f77093 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:53.000306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:53.001252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:53.001601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:53.001958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] PATH_INFO: `/v3/users/90b4be1570d14023bd0bc47547522707` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:53.004241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90b4be1570d14023bd0bc47547522707)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:53.005951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1015/2006] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:52 2022] PUT /identity/v3/projects/ef4044fecaf144fb9765093dd35a7393/users/4eaea4edbdf1463b88da30b1c3387c29/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:53.007098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:53.016160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:53.016629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:53.017110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:53.038135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:53.059720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] MFA Rules not processed for user `4eaea4edbdf1463b88da30b1c3387c29`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:53.061101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:53.063019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90b4be1570d14023bd0bc47547522707'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:53.063852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90b4be1570d14023bd0bc47547522707'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:53.064502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90b4be1570d14023bd0bc47547522707'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:53.072521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90b4be1570d14023bd0bc47547522707'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:53.086241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c8a6af43-a247-46ef-a2a2-9ca4120e5078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90b4be1570d14023bd0bc47547522707'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:53.103618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 992/2007] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:52 2022] DELETE /identity/v3/users/90b4be1570d14023bd0bc47547522707 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:53.110616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:53.110935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:53.111371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:53.142518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:53.143919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:53.148529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:53.162875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1016/2008] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:13:53.175443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:53.177657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:53.233319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 993/2009] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:53.243910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:53.245711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:53.255080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874fe78-89bc-447b-9e04-7ad4cfa1b139 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:53.332511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:53.333183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:53.333608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:53.334769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:53.381916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909593e2-557a-4ae5-9c9d-00806704e3ee None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:53.388327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:53.389369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:53.389663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:53.389946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:53.415113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:53.417549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:53.420048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:53.421843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:53.442295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1017/2010] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:53.484441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 994/2011] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:53.628496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:53.632118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:53.646756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a4896-8280-4f27-8e41-2829c1f028b1 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:53.651729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:53.652607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:53.653689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:53.654028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:53.656095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:53.753512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:53.755146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:53.760420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:53.767559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1018/2012] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:13:53.928131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:53.929961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:53.947476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da3278-da29-43e4-ad70-e9bc90dd4662 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:53.952370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:53.953885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:53.954254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:53.954766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] PATH_INFO: `/v3/projects/7462092f3e864db0853ef9ee6d298a26` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:53.956520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7462092f3e864db0853ef9ee6d298a26)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:53.959863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:54.013016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:54.020742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7462092f3e864db0853ef9ee6d298a26', 'request_id': 'req-0b4f3777-e83d-4842-960f-7b54fd2e8d35'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.028726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7462092f3e864db0853ef9ee6d298a26', 'request_id': 'req-0b4f3777-e83d-4842-960f-7b54fd2e8d35'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.035776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7462092f3e864db0853ef9ee6d298a26', 'request_id': 'req-0b4f3777-e83d-4842-960f-7b54fd2e8d35'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.047132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] The token cache is being invalidate because project 7462092f3e864db0853ef9ee6d298a26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:54.047426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.048218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.050107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 995/2013] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:53 2022] DELETE /identity/v3/projects/7462092f3e864db0853ef9ee6d298a26 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:54.055729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:54.067841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c011e9f-ae2e-480c-8292-7ea3492772dd service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:54.073032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:54.074470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:54.128610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:54.130004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:54.130289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:54.130562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] PATH_INFO: `/v3/users/dcd2ffcc344a4cebbc779c7d808f518c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:54.131778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd2ffcc344a4cebbc779c7d808f518c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:54.133700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:54.139009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3777-e83d-4842-960f-7b54fd2e8d35 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:54.143647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:54.145192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:54.145478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:54.145755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] PATH_INFO: `/v3/users/ea483e5fa4a04445804be9aca56b0a61` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:54.147012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea483e5fa4a04445804be9aca56b0a61)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:54.148941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:54.181658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd2ffcc344a4cebbc779c7d808f518c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.189295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd2ffcc344a4cebbc779c7d808f518c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.190046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd2ffcc344a4cebbc779c7d808f518c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.196020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea483e5fa4a04445804be9aca56b0a61'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.196680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea483e5fa4a04445804be9aca56b0a61'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.197308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea483e5fa4a04445804be9aca56b0a61'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.202721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd2ffcc344a4cebbc779c7d808f518c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.203613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-491f5c29-9ccc-4f42-b5dc-0ae5147248fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd2ffcc344a4cebbc779c7d808f518c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.205133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea483e5fa4a04445804be9aca56b0a61'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.216241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1019/2014] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:54 2022] DELETE /identity/v3/users/dcd2ffcc344a4cebbc779c7d808f518c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:54.220534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea483e5fa4a04445804be9aca56b0a61'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.234988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 996/2015] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:54 2022] DELETE /identity/v3/users/ea483e5fa4a04445804be9aca56b0a61 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:54.239403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:54.239700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:54.239984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:54.258116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:54.259354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:54.337361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1020/2016] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:54.367793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:54.369288 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:54.464143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:54.469138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603dee2-8ea7-44ba-8735-8dc96bd260c0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:54.477864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0831a6-bc45-47f9-99cd-df07fafb48c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:54.478527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0831a6-bc45-47f9-99cd-df07fafb48c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:54.478814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0831a6-bc45-47f9-99cd-df07fafb48c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:54.479129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0831a6-bc45-47f9-99cd-df07fafb48c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:54.490251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0831a6-bc45-47f9-99cd-df07fafb48c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:54.491768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0831a6-bc45-47f9-99cd-df07fafb48c1 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:54.507432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 997/2017] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:54.586533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:54.589986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:54.607062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cff79f-1385-449a-b4ef-8af49e8468be None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:54.615842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:54.617113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:54.617582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:54.618031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] PATH_INFO: `/v3/projects/cec3347a9c344b8e951a06235e409651` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:54.619590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cec3347a9c344b8e951a06235e409651)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:54.622774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:54.641472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:54.707435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cec3347a9c344b8e951a06235e409651', 'request_id': 'req-01ccef40-2ded-4c48-ad6a-dade072fecd3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.716963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cec3347a9c344b8e951a06235e409651', 'request_id': 'req-01ccef40-2ded-4c48-ad6a-dade072fecd3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.731675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cec3347a9c344b8e951a06235e409651', 'request_id': 'req-01ccef40-2ded-4c48-ad6a-dade072fecd3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.753132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] The token cache is being invalidate because project cec3347a9c344b8e951a06235e409651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:54.753443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.756414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:54.762579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1021/2018] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:54 2022] DELETE /identity/v3/projects/cec3347a9c344b8e951a06235e409651 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:54.763670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec24265-ff17-43de-a600-f4888f722169 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:54.763960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec24265-ff17-43de-a600-f4888f722169 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:54.764236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec24265-ff17-43de-a600-f4888f722169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:54.789993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-eec24265-ff17-43de-a600-f4888f722169 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:54.791528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-eec24265-ff17-43de-a600-f4888f722169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:54.847391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:54.848920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:54.878242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 998/2019] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:54.886137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4b283-6347-4ab8-8bac-e2899d65ef67 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:54.886510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4b283-6347-4ab8-8bac-e2899d65ef67 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:54.886972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4b283-6347-4ab8-8bac-e2899d65ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:54.919751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-45c4b283-6347-4ab8-8bac-e2899d65ef67 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:54.925269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-45c4b283-6347-4ab8-8bac-e2899d65ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:54.937303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 999/2020] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:54.951241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4b283-6347-4ab8-8bac-e2899d65ef67 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:54.987390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4b283-6347-4ab8-8bac-e2899d65ef67 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.000550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.002656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.004404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.005735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.009678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:55.010028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.011850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.027771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccef40-2ded-4c48-ad6a-dade072fecd3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.033096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.034007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.034272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.034546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] PATH_INFO: `/v3/users/fcbb043f3a9c4dd882ec223ce1a2db4b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.035863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbb043f3a9c4dd882ec223ce1a2db4b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.037785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.049174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1000/2021] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:55.050385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.057972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.083816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52cc22-f044-4503-be92-3086c87bbc15 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.089133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.090194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.090490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.090784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] PATH_INFO: `/v3/users/ce4aa071787f4a3f8a3e079e647d67f6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.092297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4aa071787f4a3f8a3e079e647d67f6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.094880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.114220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbb043f3a9c4dd882ec223ce1a2db4b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.125620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbb043f3a9c4dd882ec223ce1a2db4b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.126281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbb043f3a9c4dd882ec223ce1a2db4b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.149360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbb043f3a9c4dd882ec223ce1a2db4b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.151188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbb043f3a9c4dd882ec223ce1a2db4b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.164086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4aa071787f4a3f8a3e079e647d67f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.164801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4aa071787f4a3f8a3e079e647d67f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.165431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4aa071787f4a3f8a3e079e647d67f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.167569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1022/2022] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:54 2022] DELETE /identity/v3/users/fcbb043f3a9c4dd882ec223ce1a2db4b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:55.170583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.171505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.174018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4aa071787f4a3f8a3e079e647d67f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.189470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4aa071787f4a3f8a3e079e647d67f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.196769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:55.208604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1001/2023] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:55 2022] DELETE /identity/v3/users/ce4aa071787f4a3f8a3e079e647d67f6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:55.209697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.211266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.249650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe57ba5-925b-4e57-be06-580297e45c2d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.267042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:55.291646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7cb30-c1ba-4b71-baa5-b9077d38693b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.299032 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.299803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.300016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.300292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.301545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.304286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.315285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.316890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.317181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.317462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] PATH_INFO: `/v3/users/6dad23eb5f184d60acd8388cb67400b7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.318674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dad23eb5f184d60acd8388cb67400b7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.320634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.332688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1002/2024] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:55 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:55.333615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.335269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.379517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dad23eb5f184d60acd8388cb67400b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.391703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dad23eb5f184d60acd8388cb67400b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.392334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dad23eb5f184d60acd8388cb67400b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.405609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dad23eb5f184d60acd8388cb67400b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.406612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-72ebf04a-de14-432c-a6e6-11f6a4b8d4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dad23eb5f184d60acd8388cb67400b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.412457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba33a56-ac78-401d-8a15-28f139fd482c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.420153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.421816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.421816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.421816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] PATH_INFO: `/v3/projects/5c05bc563b954ae784a4771f3cc25364` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.423328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c05bc563b954ae784a4771f3cc25364)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.423823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1023/2025] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:55 2022] DELETE /identity/v3/users/6dad23eb5f184d60acd8388cb67400b7 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:55.425378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.428283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.428577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.428855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.448436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:55.449635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.483530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c05bc563b954ae784a4771f3cc25364', 'request_id': 'req-24c7163d-ad40-41dc-8567-532ada9e0bde'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.492755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c05bc563b954ae784a4771f3cc25364', 'request_id': 'req-24c7163d-ad40-41dc-8567-532ada9e0bde'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.498550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c05bc563b954ae784a4771f3cc25364', 'request_id': 'req-24c7163d-ad40-41dc-8567-532ada9e0bde'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.501132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:55.511346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] The token cache is being invalidate because project 5c05bc563b954ae784a4771f3cc25364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:55.511613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.512339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24c7163d-ad40-41dc-8567-532ada9e0bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.514159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1003/2026] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:55 2022] DELETE /identity/v3/projects/5c05bc563b954ae784a4771f3cc25364 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:55.515449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6109-68de-45e1-81b6-e3e51af767e0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.515744 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6109-68de-45e1-81b6-e3e51af767e0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.516025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a6109-68de-45e1-81b6-e3e51af767e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.528723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1024/2027] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:55.529874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.531463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.533736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-116a6109-68de-45e1-81b6-e3e51af767e0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:55.535497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-116a6109-68de-45e1-81b6-e3e51af767e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.547841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df538d3e-33cc-4af9-822f-b578a38acf31 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.590258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:55.602783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1004/2028] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:55.604540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.604968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.605345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.626664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.627542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.627828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.628112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.628995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.631757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.643386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:55.644990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.654378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1025/2029] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:55 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:55.654546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1005/2030] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:55.655222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.656828 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.658420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.666503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.677801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60111fd0-d656-4aec-9a91-25cbe227c5e4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.682452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.683625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.683908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.684182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] PATH_INFO: `/v3/users/4eaea4edbdf1463b88da30b1c3387c29` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.685402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eaea4edbdf1463b88da30b1c3387c29)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.687351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.727762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0570f-9015-433b-ab34-011272879bab admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.731828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.732473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.732754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.733024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.736827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eaea4edbdf1463b88da30b1c3387c29'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.737493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eaea4edbdf1463b88da30b1c3387c29'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.738733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eaea4edbdf1463b88da30b1c3387c29'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.743037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.744402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.745904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eaea4edbdf1463b88da30b1c3387c29'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.753568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1026/2031] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:55.754397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.759992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eaea4edbdf1463b88da30b1c3387c29'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:55.762061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f111b-db17-4a69-ba6a-025705fccdfe service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.766151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.766996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.767279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.767558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.769713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.774704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1006/2032] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:55 2022] DELETE /identity/v3/users/4eaea4edbdf1463b88da30b1c3387c29 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:55.775684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.777221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.786290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.787899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.799867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1027/2033] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:55.801828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.803343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.817270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622fdf-beba-4a75-855f-50068d4efb91 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.875656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b31a9d-e50e-4e9a-bec9-da800da3d348 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.883280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.884450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.885383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.885863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.886720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.889922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.895512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.896399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.896746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.897553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.901509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:55.908217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1007/2034] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:55.913164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.926095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a18765-cff5-4713-a3b8-f595c048447f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.929008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.931153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.938072 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fa768-3666-4c1a-98a5-b7264f71af8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.938887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fa768-3666-4c1a-98a5-b7264f71af8b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.939070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fa768-3666-4c1a-98a5-b7264f71af8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.939387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fa768-3666-4c1a-98a5-b7264f71af8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.940620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fa768-3666-4c1a-98a5-b7264f71af8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:55.941909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fa768-3666-4c1a-98a5-b7264f71af8b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:55.958416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1028/2035] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:55.964034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1008/2036] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:13:55.964876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:55.975126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bc1f8-3bd3-4e81-9eb6-e595af791ba3 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:55.979924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:55.980815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:55.981220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:55.981501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] PATH_INFO: `/v3/projects/15f46d6f02424080bf0d2334089d2739/users/323edadbe4404e78b346ff80e356d635/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:55.985321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:55.997604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f46d6f02424080bf0d2334089d2739, user_id=323edadbe4404e78b346ff80e356d635, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.000291 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.013725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1029/2037] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:55 2022] PUT /identity/v3/projects/15f46d6f02424080bf0d2334089d2739/users/323edadbe4404e78b346ff80e356d635/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:56.024716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5196ee-51ee-4212-a07d-e59bb6443677 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.025044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5196ee-51ee-4212-a07d-e59bb6443677 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.025331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5196ee-51ee-4212-a07d-e59bb6443677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.052169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-df5196ee-51ee-4212-a07d-e59bb6443677 None None] MFA Rules not processed for user `323edadbe4404e78b346ff80e356d635`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:56.053408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-df5196ee-51ee-4212-a07d-e59bb6443677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:56.125622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:56.162261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1009/2038] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:56.166961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.244207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bc3cd-c2cf-40b8-a901-b965e2dc60dd admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.249239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.249923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.250451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.251375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.251761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.254383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.286700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1030/2039] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:56 2022] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:56.291369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5196ee-51ee-4212-a07d-e59bb6443677 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.303599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5196ee-51ee-4212-a07d-e59bb6443677 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.369857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.370715 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.371400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.371787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.372595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.374682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.400532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1010/2040] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:56 2022] POST /identity/v3/users => generated 301 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:13:56.404567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.418891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522309b-e94e-4170-9b8f-f46bdd3f6ea6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.425255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.426030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.426423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.427333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.428139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.430195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.453724 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1031/2041] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:56.456763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.469253 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1060843e-8056-4e60-b5bb-41ba4c9f1f76 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.474526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.475714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.475908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.476191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] PATH_INFO: `/v3/projects/f33457f5b260446aa921b508d30538ab/users/bb92452d404b49b5ac4cefd723d0dd2c/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.499532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.501646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:56.507545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33457f5b260446aa921b508d30538ab, user_id=bb92452d404b49b5ac4cefd723d0dd2c, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.530790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.543261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bb9df-9eb8-4447-9063-5d08c6ef1250 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.559337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.560498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.561049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.561355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] PATH_INFO: `/v3/projects/42e2eb92df4742388b550a9d8102c4d4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.566905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e2eb92df4742388b550a9d8102c4d4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.569778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.588276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1011/2042] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:56 2022] PUT /identity/v3/projects/f33457f5b260446aa921b508d30538ab/users/bb92452d404b49b5ac4cefd723d0dd2c/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:56.593838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.639727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e2eb92df4742388b550a9d8102c4d4', 'request_id': 'req-9206188a-9d95-4415-a494-30c9cff948bb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:56.649356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e2eb92df4742388b550a9d8102c4d4', 'request_id': 'req-9206188a-9d95-4415-a494-30c9cff948bb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:56.655307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e2eb92df4742388b550a9d8102c4d4', 'request_id': 'req-9206188a-9d95-4415-a494-30c9cff948bb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:56.679515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] The token cache is being invalidate because project 42e2eb92df4742388b550a9d8102c4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:56.679810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:56.680667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9206188a-9d95-4415-a494-30c9cff948bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:56.683904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1032/2043] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:56 2022] DELETE /identity/v3/projects/42e2eb92df4742388b550a9d8102c4d4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:56.689400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef582f-dba2-4f52-917f-50b50e08d35d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.689740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef582f-dba2-4f52-917f-50b50e08d35d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.690024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef582f-dba2-4f52-917f-50b50e08d35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.700952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f528cd-7612-44e8-8027-db20002850e1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.746557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-79ef582f-dba2-4f52-917f-50b50e08d35d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:56.748458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-79ef582f-dba2-4f52-917f-50b50e08d35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:56.758887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:56.770308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.771143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.771501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.771863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.772621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.775105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.789710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1012/2044] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:56.794599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.798688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:56.812151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997df14-f09e-4fca-a819-cf4dc51335d0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.818082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.819104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.819456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.819948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] PATH_INFO: `/v3/projects/f33457f5b260446aa921b508d30538ab/users/bb92452d404b49b5ac4cefd723d0dd2c/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.822717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f33457f5b260446aa921b508d30538ab, user_id=bb92452d404b49b5ac4cefd723d0dd2c, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.826092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:56.838103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:56.848641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1013/2045] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:56 2022] PUT /identity/v3/projects/f33457f5b260446aa921b508d30538ab/users/bb92452d404b49b5ac4cefd723d0dd2c/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:13:56.848641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:56.848641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:56.903398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1033/2046] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:56.916448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f320c1c-9c27-4ce7-83f0-b1e08dfc6e2e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.916876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f320c1c-9c27-4ce7-83f0-b1e08dfc6e2e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.917157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f320c1c-9c27-4ce7-83f0-b1e08dfc6e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.958238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee17458-4194-4af5-ac40-282d02c02e44 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:56.966208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:56.966324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7f320c1c-9c27-4ce7-83f0-b1e08dfc6e2e None None] MFA Rules not processed for user `bb92452d404b49b5ac4cefd723d0dd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:56.966440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:56.966440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:56.966602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7f320c1c-9c27-4ce7-83f0-b1e08dfc6e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:56.966686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] PATH_INFO: `/v3/projects/ef4044fecaf144fb9765093dd35a7393` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:56.967821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4044fecaf144fb9765093dd35a7393)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:56.970321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.044076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4044fecaf144fb9765093dd35a7393', 'request_id': 'req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.057835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4044fecaf144fb9765093dd35a7393', 'request_id': 'req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.073428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4044fecaf144fb9765093dd35a7393', 'request_id': 'req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.079154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1034/2047] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:57.079154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.079154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.079154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.090887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] The token cache is being invalidate because project ef4044fecaf144fb9765093dd35a7393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:57.090887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.092910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.093764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1014/2048] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:56 2022] DELETE /identity/v3/projects/ef4044fecaf144fb9765093dd35a7393 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:57.094665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.099465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.111071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:57.112575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.172035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93d58c-31fa-4428-a6ef-a3d2a02c47b8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.178791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:57.179923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.180367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.180798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] PATH_INFO: `/v3/projects/2112e2a0ccaa44a4a8ee4157e9051b7d` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.182183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2112e2a0ccaa44a4a8ee4157e9051b7d)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:57.184568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.185671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1035/2049] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:57.186822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.189009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.196239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:57.204277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457b06e-bf9e-4944-80f4-a9659938a481 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.209643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:57.210509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.210791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.211100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] PATH_INFO: `/v3/projects/596045b5716e4a2b820b5182cdb9fc86` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.212293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596045b5716e4a2b820b5182cdb9fc86)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:57.214239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.238862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2112e2a0ccaa44a4a8ee4157e9051b7d', 'request_id': 'req-10a39631-c8bf-47d9-b347-2bf9ae862f37'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.246938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2112e2a0ccaa44a4a8ee4157e9051b7d', 'request_id': 'req-10a39631-c8bf-47d9-b347-2bf9ae862f37'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.253363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2112e2a0ccaa44a4a8ee4157e9051b7d', 'request_id': 'req-10a39631-c8bf-47d9-b347-2bf9ae862f37'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.265022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] The token cache is being invalidate because project 2112e2a0ccaa44a4a8ee4157e9051b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:57.265282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.265915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.268015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1015/2050] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:57 2022] DELETE /identity/v3/projects/2112e2a0ccaa44a4a8ee4157e9051b7d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:57.268125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596045b5716e4a2b820b5182cdb9fc86', 'request_id': 'req-84a72b57-bc92-4916-bb2e-e72ab7888a20'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.268385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.269977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.273925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596045b5716e4a2b820b5182cdb9fc86', 'request_id': 'req-84a72b57-bc92-4916-bb2e-e72ab7888a20'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.280566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596045b5716e4a2b820b5182cdb9fc86', 'request_id': 'req-84a72b57-bc92-4916-bb2e-e72ab7888a20'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.282258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:57.295794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] The token cache is being invalidate because project 596045b5716e4a2b820b5182cdb9fc86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:57.296097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.296723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-84a72b57-bc92-4916-bb2e-e72ab7888a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.298706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1036/2051] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:57 2022] DELETE /identity/v3/projects/596045b5716e4a2b820b5182cdb9fc86 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:57.303829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf106e-6cfa-4d1b-b52a-818ef3a05f5c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.304115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf106e-6cfa-4d1b-b52a-818ef3a05f5c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.304386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf106e-6cfa-4d1b-b52a-818ef3a05f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.322665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ebdf106e-6cfa-4d1b-b52a-818ef3a05f5c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:57.324540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ebdf106e-6cfa-4d1b-b52a-818ef3a05f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.331444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a39631-c8bf-47d9-b347-2bf9ae862f37 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.380935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:57.381589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.381869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.382140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.383985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.384708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1037/2052] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:57.386062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425b6b-30a1-499d-a0f7-068742cbed5b None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.386354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425b6b-30a1-499d-a0f7-068742cbed5b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.386633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb425b6b-30a1-499d-a0f7-068742cbed5b None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.388121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1038/2053] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:13:57.388708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425b6b-30a1-499d-a0f7-068742cbed5b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.390596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-bb425b6b-30a1-499d-a0f7-068742cbed5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.406683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb425b6b-30a1-499d-a0f7-068742cbed5b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.412168 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:57.412839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.413333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.413446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.414114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:57.414762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:57.416187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.428171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1039/2054] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:57.429053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.430796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.443456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3912d0-18c4-45f8-b97b-3f2d00236d8f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.448016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:57.448851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.449133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.449406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] PATH_INFO: `/v3/users/9b03f848bf5d43c8be9d2a9bff06dcd1` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.450572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b03f848bf5d43c8be9d2a9bff06dcd1)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:57.452497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.453105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:57.454587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.464689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1016/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:57.465468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.466966 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.475094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:57.497353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c516ff-a06e-4ca1-84da-eadaa3303793 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.503305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:57.504448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.504992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.505367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] PATH_INFO: `/v3/users/17123472e57c4547ab6ddf0e9ec72d16` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.507242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17123472e57c4547ab6ddf0e9ec72d16)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:57.509594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.515513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b03f848bf5d43c8be9d2a9bff06dcd1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.524418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b03f848bf5d43c8be9d2a9bff06dcd1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.524812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b03f848bf5d43c8be9d2a9bff06dcd1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.547148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b03f848bf5d43c8be9d2a9bff06dcd1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.547966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b03f848bf5d43c8be9d2a9bff06dcd1'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.563074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1040/2056] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:57 2022] DELETE /identity/v3/users/9b03f848bf5d43c8be9d2a9bff06dcd1 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:57.563893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.567069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.580039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17123472e57c4547ab6ddf0e9ec72d16'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.581060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17123472e57c4547ab6ddf0e9ec72d16'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.582392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17123472e57c4547ab6ddf0e9ec72d16'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.595076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17123472e57c4547ab6ddf0e9ec72d16'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.610963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6c4efe72-5d64-4fe2-a7ca-86e9903570a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17123472e57c4547ab6ddf0e9ec72d16'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.634711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1017/2057] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:57 2022] DELETE /identity/v3/users/17123472e57c4547ab6ddf0e9ec72d16 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:57.636500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7705a13-df7e-41f0-b664-17ebc7647fdf None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.637147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7705a13-df7e-41f0-b664-17ebc7647fdf None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.637686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7705a13-df7e-41f0-b664-17ebc7647fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.648386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:57.662643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e7705a13-df7e-41f0-b664-17ebc7647fdf None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:57.664187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e7705a13-df7e-41f0-b664-17ebc7647fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.664777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a061d8-3738-4f76-a031-c46e1fd571cc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.750254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:57.751216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.751497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.751902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] PATH_INFO: `/v3/users/593107c857f54d69be7d7982dc0eacd8` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.754472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=593107c857f54d69be7d7982dc0eacd8)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:57.755818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1018/2058] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:57.758570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:57.760346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:57.763184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:57.763479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:57.797662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] MFA Rules not processed for user `1425168ddd274cf3a5c59d0cbedaf0f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:57.799214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.843184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593107c857f54d69be7d7982dc0eacd8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.852203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593107c857f54d69be7d7982dc0eacd8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.853096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593107c857f54d69be7d7982dc0eacd8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.869251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593107c857f54d69be7d7982dc0eacd8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.870092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593107c857f54d69be7d7982dc0eacd8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:57.897703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1041/2059] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:57 2022] DELETE /identity/v3/users/593107c857f54d69be7d7982dc0eacd8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:57.898457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.899858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.931428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1019/2060] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:13:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:57.932825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:57.934177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:57.954773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114f886-ff0b-4a88-b3d9-0fe1b2ea02cf None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:57.970376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:57.995714 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2a5d2-fcc7-4101-8ae6-2eca03fb5dbd admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.004193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.004943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.005329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.005673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.006898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.012507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.043738 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.044698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.045056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.045464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] PATH_INFO: `/v3/users/323edadbe4404e78b346ff80e356d635` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.047165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323edadbe4404e78b346ff80e356d635)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.049044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.064940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1042/2061] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:57 2022] POST /identity/v3/projects => generated 373 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:58.064940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.065597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.073998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:58.136967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323edadbe4404e78b346ff80e356d635'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.140123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323edadbe4404e78b346ff80e356d635'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.140816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323edadbe4404e78b346ff80e356d635'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.151035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323edadbe4404e78b346ff80e356d635'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.163292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49d113-2a09-4552-8a10-94343bd81950 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.169632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.169790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323edadbe4404e78b346ff80e356d635'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.170658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.170986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.171882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.172781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:58.173262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.174951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.187668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1020/2062] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:57 2022] DELETE /identity/v3/users/323edadbe4404e78b346ff80e356d635 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:58.188941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.190864 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.195186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1043/2063] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:58.198376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.201166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.271931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b228d8-67e1-424a-aef2-78f26ee369f7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.277505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.278537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.278829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.279135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] PATH_INFO: `/v3/projects/86656b5c0510472fad2eccc8147ea4d5` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.283017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] RBAC: Authorizing `identity:delete_project(project_id=86656b5c0510472fad2eccc8147ea4d5)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.283324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b390c8-5e92-4693-a448-10d9e3694399 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.283436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.325647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:58.341757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86656b5c0510472fad2eccc8147ea4d5', 'request_id': 'req-7bb13526-fd2d-4185-9f94-53976df621af'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.349586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86656b5c0510472fad2eccc8147ea4d5', 'request_id': 'req-7bb13526-fd2d-4185-9f94-53976df621af'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.353015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.353666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.353948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.354221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.355602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86656b5c0510472fad2eccc8147ea4d5', 'request_id': 'req-7bb13526-fd2d-4185-9f94-53976df621af'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.356050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.367032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.367203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] The token cache is being invalidate because project 86656b5c0510472fad2eccc8147ea4d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:58.367511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.368167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.368608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.369750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1021/2064] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:58 2022] DELETE /identity/v3/projects/86656b5c0510472fad2eccc8147ea4d5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:58.373245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.373245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.379263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1044/2065] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:58.380044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.381328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.395413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72f0dc-66e5-436a-9c4d-45bce5f3a7ff service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.426651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:58.445586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13526-fd2d-4185-9f94-53976df621af admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.450452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.451361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.451646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.451922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] PATH_INFO: `/v3/projects/661d0605098e4014a73d8faadb0bb9e4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.453120 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=661d0605098e4014a73d8faadb0bb9e4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.455221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.459445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9380d6-ed7b-4bf8-abb6-4eda0f27204e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.460136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9380d6-ed7b-4bf8-abb6-4eda0f27204e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.460419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9380d6-ed7b-4bf8-abb6-4eda0f27204e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.460694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9380d6-ed7b-4bf8-abb6-4eda0f27204e admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.461387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9380d6-ed7b-4bf8-abb6-4eda0f27204e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.463331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9380d6-ed7b-4bf8-abb6-4eda0f27204e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.486863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1045/2066] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:58.488223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.488647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.488935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.510137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:58.511407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.521140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '661d0605098e4014a73d8faadb0bb9e4', 'request_id': 'req-9bee4df5-88e8-4842-a776-17a6e4aa9121'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.530035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '661d0605098e4014a73d8faadb0bb9e4', 'request_id': 'req-9bee4df5-88e8-4842-a776-17a6e4aa9121'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.536357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '661d0605098e4014a73d8faadb0bb9e4', 'request_id': 'req-9bee4df5-88e8-4842-a776-17a6e4aa9121'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.548771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] The token cache is being invalidate because project 661d0605098e4014a73d8faadb0bb9e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:58.549055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.549705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.551410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1022/2067] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:58 2022] DELETE /identity/v3/projects/661d0605098e4014a73d8faadb0bb9e4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:58.554642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.554642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.576955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1046/2068] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:58.577809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.579145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.591420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be614b09-b7c8-4316-b8d9-f1c374132d7c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.595970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.596814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.597121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.597426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] PATH_INFO: `/v3/projects/e9a208f22d6a471d9ff773383458cb99` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.598715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a208f22d6a471d9ff773383458cb99)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.600806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.607564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:58.621680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee4df5-88e8-4842-a776-17a6e4aa9121 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.632975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee565ee-f949-43d9-a7bd-5734ad86a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.633899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee565ee-f949-43d9-a7bd-5734ad86a1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.634198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee565ee-f949-43d9-a7bd-5734ad86a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.634526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee565ee-f949-43d9-a7bd-5734ad86a1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.635369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee565ee-f949-43d9-a7bd-5734ad86a1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.637359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee565ee-f949-43d9-a7bd-5734ad86a1bb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.649742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a208f22d6a471d9ff773383458cb99', 'request_id': 'req-710a3317-fa2c-4364-bf6a-c2f4b0288be0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.655345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a208f22d6a471d9ff773383458cb99', 'request_id': 'req-710a3317-fa2c-4364-bf6a-c2f4b0288be0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.661846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a208f22d6a471d9ff773383458cb99', 'request_id': 'req-710a3317-fa2c-4364-bf6a-c2f4b0288be0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.664510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1023/2069] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:58.665912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4c804-a4db-4fac-83a3-72ba9c0de45c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.666203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4c804-a4db-4fac-83a3-72ba9c0de45c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.666480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4c804-a4db-4fac-83a3-72ba9c0de45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.676594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] The token cache is being invalidate because project e9a208f22d6a471d9ff773383458cb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:58.676886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.677523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:58.679094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1047/2070] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:58 2022] DELETE /identity/v3/projects/e9a208f22d6a471d9ff773383458cb99 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:58.680058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.681164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.685885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8ce4c804-a4db-4fac-83a3-72ba9c0de45c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:58.687084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8ce4c804-a4db-4fac-83a3-72ba9c0de45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.727321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:58.747138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1024/2071] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:58.748424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.748717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.748997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.751245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a3317-fa2c-4364-bf6a-c2f4b0288be0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.756966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.757599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.757877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.758289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.759054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.760648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.767413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:58.768617 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.771604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1048/2072] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:58.772273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.775163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.779908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1025/2073] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:58.780728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.782023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.793716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a05eef-ed98-4d0a-8d69-54117bb8edf2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.798301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eac3a2-01fe-4e53-9b37-f3300f6b4d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.799042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac3a2-01fe-4e53-9b37-f3300f6b4d6f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.799333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac3a2-01fe-4e53-9b37-f3300f6b4d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.799615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eac3a2-01fe-4e53-9b37-f3300f6b4d6f admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.800299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eac3a2-01fe-4e53-9b37-f3300f6b4d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.802819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eac3a2-01fe-4e53-9b37-f3300f6b4d6f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.824299 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1026/2074] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:58.825649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7d8da-ed43-4e17-b211-de05650ce823 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.825941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7d8da-ed43-4e17-b211-de05650ce823 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.826223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7d8da-ed43-4e17-b211-de05650ce823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.844254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd94b76-83b6-46bc-9c43-de1f1509acbc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.847988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.848630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.848910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.849180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.851039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.851628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-31b7d8da-ed43-4e17-b211-de05650ce823 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:58.852804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-31b7d8da-ed43-4e17-b211-de05650ce823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.860698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1027/2075] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:58.861929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5cb2a-77b0-45e1-86e9-434cd7c3201d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.862221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5cb2a-77b0-45e1-86e9-434cd7c3201d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.862502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b5cb2a-77b0-45e1-86e9-434cd7c3201d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.870411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.871941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.880881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a3b5cb2a-77b0-45e1-86e9-434cd7c3201d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:58.882066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a3b5cb2a-77b0-45e1-86e9-434cd7c3201d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.882541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1049/2076] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:58.883439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.893191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1028/2077] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:58.893191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720d394-edbe-4a6b-8316-7b6dc44c81dd None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.893191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720d394-edbe-4a6b-8316-7b6dc44c81dd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.893191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720d394-edbe-4a6b-8316-7b6dc44c81dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.896443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0a548-e735-4cd9-9b49-eb08cd0c2089 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.901584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.902252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.902539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.902816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.903591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.905195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.911527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1720d394-edbe-4a6b-8316-7b6dc44c81dd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:58.912732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1720d394-edbe-4a6b-8316-7b6dc44c81dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.916370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1050/2078] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:58.920030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.922934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1029/2079] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:58.924250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af96c5-4249-40ca-8f7a-78ffa25b323b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.924632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af96c5-4249-40ca-8f7a-78ffa25b323b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.924921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af96c5-4249-40ca-8f7a-78ffa25b323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.937646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59869f84-7d5d-489d-9992-5b1255d1bc92 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.944108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.944810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.945145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.945497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-81af96c5-4249-40ca-8f7a-78ffa25b323b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:58.945611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.946206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.946630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-81af96c5-4249-40ca-8f7a-78ffa25b323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:58.947907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.955983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1030/2080] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:58.956776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af96c5-4249-40ca-8f7a-78ffa25b323b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.966832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1051/2081] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:58.967903 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:58.969538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af96c5-4249-40ca-8f7a-78ffa25b323b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.975517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.976250 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.976634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.976920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.977669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:58.977982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:58.979472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc282e64-ffa5-4f7d-8305-78fb93758e0e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:58.979670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:58.984645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:58.985809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:58.985809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:58.986084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] PATH_INFO: `/v3/projects/da1bbfa47c4b4f059241db41c2f71a7b/users/25c94c46e07f479fa75d867dbdeb1f77/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:58.992529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1031/2082] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:58.995922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.007761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aaad2-72ac-4ed9-8f23-e63ab6a3bf2e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.008542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1bbfa47c4b4f059241db41c2f71a7b, user_id=25c94c46e07f479fa75d867dbdeb1f77, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.011660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.014239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.015171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.015521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.015741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.016625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:59.017090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.018992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.026830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1052/2083] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:58 2022] PUT /identity/v3/projects/da1bbfa47c4b4f059241db41c2f71a7b/users/25c94c46e07f479fa75d867dbdeb1f77/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:59.028936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.033866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1032/2084] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:59.034873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.048587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a660e6e-5300-4ed9-9e2a-68d2b925f642 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.114180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.115098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.115212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.115439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.116177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.117783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.119206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:59.131040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8638a1-8307-4280-998e-0952bd3a8f4d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.133848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1033/2085] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:59.134979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.139409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07bf5fb-e45e-4154-bec0-cacd7cb87773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.140276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf5fb-e45e-4154-bec0-cacd7cb87773 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.140566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf5fb-e45e-4154-bec0-cacd7cb87773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.140847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07bf5fb-e45e-4154-bec0-cacd7cb87773 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.141821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bf5fb-e45e-4154-bec0-cacd7cb87773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:13:59.142142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bf5fb-e45e-4154-bec0-cacd7cb87773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.143852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07bf5fb-e45e-4154-bec0-cacd7cb87773 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.146544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c2175-c8c5-42a6-902f-af25699d2bfc admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.162726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1053/2086] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:13:59.163204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.164348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.164705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d33a2b-1e1a-4977-9db9-2c7a349d4c07 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.165004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d33a2b-1e1a-4977-9db9-2c7a349d4c07 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.165286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d33a2b-1e1a-4977-9db9-2c7a349d4c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.165496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.165996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.167201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.169548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.204894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c8d33a2b-1e1a-4977-9db9-2c7a349d4c07 None None] MFA Rules not processed for user `25c94c46e07f479fa75d867dbdeb1f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:59.206131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c8d33a2b-1e1a-4977-9db9-2c7a349d4c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.214403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1034/2087] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:59.215831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.227330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:59.293306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1054/2088] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:59.295032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d33a2b-1e1a-4977-9db9-2c7a349d4c07 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.308440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d33a2b-1e1a-4977-9db9-2c7a349d4c07 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.326373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972e5e-1141-439b-a7a2-ec48386a0c53 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.331222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.332024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.332376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.332755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.333502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.335529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.365902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1035/2089] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:59.365902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.372953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.374068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.374353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.374700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] PATH_INFO: `/v3/projects/5d96887abe874566977681d461d96520/users/63bb8c804b0c4ef5a4c94888fa5d54e3/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.389835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d96887abe874566977681d461d96520, user_id=63bb8c804b0c4ef5a4c94888fa5d54e3, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.393457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.412410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1055/2090] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:13:59 2022] PUT /identity/v3/projects/5d96887abe874566977681d461d96520/users/63bb8c804b0c4ef5a4c94888fa5d54e3/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:59.413556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.442487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d46897-fab8-42a2-b487-4566ccb39eca admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.477631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b26e75-f923-4a82-a7ca-219b1d3dec54 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.482281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.482995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.483279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.483555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.484275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.486449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.502173 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.502929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.503153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.503431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.504142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.507905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.513882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1056/2091] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/users => generated 303 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:59.513882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.513882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.524401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:59.527244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd94377-048e-44bd-b5dd-9e755b163d6e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.532029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.533074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.533366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.533662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] PATH_INFO: `/v3/projects/15f46d6f02424080bf0d2334089d2739` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.535629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f46d6f02424080bf0d2334089d2739)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.538077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.546033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1036/2092] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:59.546909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.548492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.575178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:59.598728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f46d6f02424080bf0d2334089d2739', 'request_id': 'req-38987a6a-2514-460e-b82c-770a57ba0bb3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.605213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f46d6f02424080bf0d2334089d2739', 'request_id': 'req-38987a6a-2514-460e-b82c-770a57ba0bb3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.607642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48778d-5505-473a-b66d-254d5c2a2866 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.611793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f46d6f02424080bf0d2334089d2739', 'request_id': 'req-38987a6a-2514-460e-b82c-770a57ba0bb3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.623973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] The token cache is being invalidate because project 15f46d6f02424080bf0d2334089d2739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:13:59.624255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.624909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.626460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1057/2093] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:13:59 2022] DELETE /identity/v3/projects/15f46d6f02424080bf0d2334089d2739 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:59.627310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.631642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.662173 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.662940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.663235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.663513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.665409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.696376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38987a6a-2514-460e-b82c-770a57ba0bb3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.701550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff7e13-230d-4e52-81dc-03c40effefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.702206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7e13-230d-4e52-81dc-03c40effefad admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.702490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7e13-230d-4e52-81dc-03c40effefad admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.702780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff7e13-230d-4e52-81dc-03c40effefad admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.703526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff7e13-230d-4e52-81dc-03c40effefad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.705429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff7e13-230d-4e52-81dc-03c40effefad admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.725600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.729618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1058/2094] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:59.729740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.729818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf703-8af8-4974-96ce-38412dbead51 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.729818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf703-8af8-4974-96ce-38412dbead51 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.729818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8bf703-8af8-4974-96ce-38412dbead51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.736414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1037/2095] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:13:59.737144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.738506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.751977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd99a6-b07c-4920-9ad8-1cdd03e17aee service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.755691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1e8bf703-8af8-4974-96ce-38412dbead51 None None] MFA Rules not processed for user `63bb8c804b0c4ef5a4c94888fa5d54e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:13:59.756894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1e8bf703-8af8-4974-96ce-38412dbead51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.757348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.758019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.758370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.758635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.759501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.761090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.772046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1038/2096] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:59.772654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.774335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.788094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d90b07-981f-4222-97f4-0cefa65133c5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.793626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.793921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.794206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.794481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.795193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.797168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.820773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1039/2097] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:13:59.821486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.823423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.836667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1059/2098] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:13:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:13:59.837256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936fabf-4748-47cf-a2ff-6d463119844c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.837910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf703-8af8-4974-96ce-38412dbead51 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.849103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.850029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.850253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8bf703-8af8-4974-96ce-38412dbead51 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.850365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.850581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] PATH_INFO: `/v3/users/bb92452d404b49b5ac4cefd723d0dd2c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.851841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb92452d404b49b5ac4cefd723d0dd2c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.854501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.855270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.855896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.856178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.856453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.857231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.858875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.869598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1060/2099] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:59.873323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.883054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7db2c-daf6-4aa8-8cb9-6a5612e96553 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.890645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.891596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.892025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.892320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.893431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.893985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:59.895702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.907697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1061/2100] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:59.908941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.920763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb92452d404b49b5ac4cefd723d0dd2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.921473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a3b8d-7667-482f-b69f-9f49044c0433 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.922084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb92452d404b49b5ac4cefd723d0dd2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.923177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb92452d404b49b5ac4cefd723d0dd2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.926382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:13:59.927215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:13:59.927478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:13:59.927801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:13:59.928581 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:13:59.930376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:13:59.931578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb92452d404b49b5ac4cefd723d0dd2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.936354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:13:59.944935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1062/2101] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:13:59.946273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.946781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb92452d404b49b5ac4cefd723d0dd2c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:13:59.949619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:13:59.961017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1040/2102] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:13:59 2022] DELETE /identity/v3/users/bb92452d404b49b5ac4cefd723d0dd2c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:13:59.961999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:13:59.964975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249b351-5374-4e2d-8204-0380cf0e9c1d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:13:59.968537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.036091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.037276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.037634 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.037980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.041364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.041954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba91ada-dcee-4eb4-a927-944a67fce2f3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.047401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.048170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.048460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.048747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.049746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.051618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.063621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1041/2103] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:00.064951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.066706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.079986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884ba8-748a-44c2-a132-891a9053be84 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.085465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.086407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.086711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.087073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] PATH_INFO: `/v3/projects/9e82aab8b24345c8bf844775289be946/users/efe7984fa361418f8223cb0f7049794c/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.123413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e82aab8b24345c8bf844775289be946, user_id=efe7984fa361418f8223cb0f7049794c, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.126756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.155439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1042/2104] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:00 2022] PUT /identity/v3/projects/9e82aab8b24345c8bf844775289be946/users/efe7984fa361418f8223cb0f7049794c/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:00.155439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.155439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.173143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.174694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.197387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1063/2105] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:13:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:00.198729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.212670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe05236-409a-4811-b69d-cd2a01347650 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.243046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdfff12-c9d7-41bf-a752-adb0ea5bd9e4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.248625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8f046-afd9-4b3f-b0a1-59a7bbc189f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.248625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f046-afd9-4b3f-b0a1-59a7bbc189f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.248843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f046-afd9-4b3f-b0a1-59a7bbc189f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.249036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8f046-afd9-4b3f-b0a1-59a7bbc189f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.249776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f046-afd9-4b3f-b0a1-59a7bbc189f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.252884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8f046-afd9-4b3f-b0a1-59a7bbc189f7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.275771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1043/2106] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:00.282519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9649-29c7-4e90-aa9e-519c09710ec4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.283784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9649-29c7-4e90-aa9e-519c09710ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.285517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e9649-29c7-4e90-aa9e-519c09710ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.290641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.291677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.291962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.292309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] PATH_INFO: `/v3/projects/0c0a8c265f5e483289042fde3daca2e1/users/a5d4e1b29a84415ebc2cb399eb4c8c80/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.310224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0a8c265f5e483289042fde3daca2e1, user_id=a5d4e1b29a84415ebc2cb399eb4c8c80, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.312918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.334739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1064/2107] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:00 2022] PUT /identity/v3/projects/0c0a8c265f5e483289042fde3daca2e1/users/a5d4e1b29a84415ebc2cb399eb4c8c80/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:00.335515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.341642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:00.349570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-417e9649-29c7-4e90-aa9e-519c09710ec4 None None] MFA Rules not processed for user `efe7984fa361418f8223cb0f7049794c`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:00.352958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-417e9649-29c7-4e90-aa9e-519c09710ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.402473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:00.438583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c2e22-9223-428d-8f10-2123632e023a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.447268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.448245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.448598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.449005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] PATH_INFO: `/v3/projects/89a94e49889447ff8c570dd60df1b5c9/users/d9d03fc440f34e77a8ada5914d077acd/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.467691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1044/2108] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:00.469094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87751e-f83f-4426-acad-c008dd7b9d18 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.469385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87751e-f83f-4426-acad-c008dd7b9d18 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.469656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87751e-f83f-4426-acad-c008dd7b9d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.473888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a94e49889447ff8c570dd60df1b5c9, user_id=d9d03fc440f34e77a8ada5914d077acd, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.477505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.497637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1065/2109] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:00 2022] PUT /identity/v3/projects/89a94e49889447ff8c570dd60df1b5c9/users/d9d03fc440f34e77a8ada5914d077acd/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:00.508010 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.508127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8c87751e-f83f-4426-acad-c008dd7b9d18 None None] MFA Rules not processed for user `a5d4e1b29a84415ebc2cb399eb4c8c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:00.508127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8c87751e-f83f-4426-acad-c008dd7b9d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.509986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.591410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c77bf-1460-4f0d-9636-f7eb0e281bae admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.595674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1045/2110] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:00.596575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87751e-f83f-4426-acad-c008dd7b9d18 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.603523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.604431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.604721 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.604997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] PATH_INFO: `/v3/projects/f33457f5b260446aa921b508d30538ab` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.611164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f33457f5b260446aa921b508d30538ab)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.614687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.620831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87751e-f83f-4426-acad-c008dd7b9d18 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.627407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9e118-dd24-4c83-b8aa-f10716c2f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.628178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9e118-dd24-4c83-b8aa-f10716c2f3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.629501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9e118-dd24-4c83-b8aa-f10716c2f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.629981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9e118-dd24-4c83-b8aa-f10716c2f3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.630757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9e118-dd24-4c83-b8aa-f10716c2f3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.633148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9e118-dd24-4c83-b8aa-f10716c2f3b7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.665122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1046/2111] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:00.666498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.666797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.667121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.679741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f33457f5b260446aa921b508d30538ab', 'request_id': 'req-285ed0cc-ebe4-4451-8d38-347aa4bb2098'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:00.686220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f33457f5b260446aa921b508d30538ab', 'request_id': 'req-285ed0cc-ebe4-4451-8d38-347aa4bb2098'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:00.693055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f33457f5b260446aa921b508d30538ab', 'request_id': 'req-285ed0cc-ebe4-4451-8d38-347aa4bb2098'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:00.695552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] MFA Rules not processed for user `d9d03fc440f34e77a8ada5914d077acd`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:00.696819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.707935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] The token cache is being invalidate because project f33457f5b260446aa921b508d30538ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:00.708463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:00.708949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:00.710513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1066/2112] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:00 2022] DELETE /identity/v3/projects/f33457f5b260446aa921b508d30538ab => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:00.711468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.712818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.768659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:00.772473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285ed0cc-ebe4-4451-8d38-347aa4bb2098 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.776651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1047/2113] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:00.777250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:00.777484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.779716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.829719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.830624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.830959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.831235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.833316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.845306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b1af-1bc3-4e08-bb7f-d764c24c5515 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.855598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa285d6-5aec-4bbf-b2b5-65eab99460a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.857641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa285d6-5aec-4bbf-b2b5-65eab99460a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.857934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa285d6-5aec-4bbf-b2b5-65eab99460a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.858219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa285d6-5aec-4bbf-b2b5-65eab99460a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.858952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa285d6-5aec-4bbf-b2b5-65eab99460a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.862345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa285d6-5aec-4bbf-b2b5-65eab99460a6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.882951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1048/2114] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:00.884326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ab36-a55e-4918-a265-9415b98db196 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.884621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ab36-a55e-4918-a265-9415b98db196 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.884901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7ab36-a55e-4918-a265-9415b98db196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.900225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.901624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.902827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d8c7ab36-a55e-4918-a265-9415b98db196 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:00.904030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d8c7ab36-a55e-4918-a265-9415b98db196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.912112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1067/2115] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:00.912767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1049/2116] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:00.913229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.913543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ab36-a55e-4918-a265-9415b98db196 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.919947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.924145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7ab36-a55e-4918-a265-9415b98db196 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.930649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9905c-ac88-4371-ac3a-1fa153c89d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.931351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9905c-ac88-4371-ac3a-1fa153c89d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.931629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9905c-ac88-4371-ac3a-1fa153c89d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.931912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9905c-ac88-4371-ac3a-1fa153c89d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.932894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9905c-ac88-4371-ac3a-1fa153c89d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.934479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9905c-ac88-4371-ac3a-1fa153c89d32 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.936335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667cae5-2a08-4b6d-9d9e-c2cc42a0171f service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:00.941513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:00.942531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.943124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.943522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.944208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:00.945379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1050/2117] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:00.946675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:00.946965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98465d-5c0e-429b-b53f-ccf788827653 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:00.947055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98465d-5c0e-429b-b53f-ccf788827653 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:00.947291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98465d-5c0e-429b-b53f-ccf788827653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:00.965183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7c98465d-5c0e-429b-b53f-ccf788827653 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:00.966390 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7c98465d-5c0e-429b-b53f-ccf788827653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:00.979534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1051/2118] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:00.979695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1068/2119] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:00.979802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98465d-5c0e-429b-b53f-ccf788827653 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.980614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:00.987119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98465d-5c0e-429b-b53f-ccf788827653 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.049311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.050329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.050977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0173df1-fa7a-4ed2-b5c4-419ec33cba49 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.051256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.051481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] PATH_INFO: `/v3/projects/9eeed0fe33f7477bad70f7df301ccb06/users/c0ad7f96e46a4fe5beaad5d6e44db936/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.056741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.057794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.058087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.058366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.059093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.061053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.072426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eeed0fe33f7477bad70f7df301ccb06, user_id=c0ad7f96e46a4fe5beaad5d6e44db936, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.075555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.087490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1069/2120] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:00 2022] POST /identity/v3/users => generated 300 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:01.090283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.091203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1052/2121] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:00 2022] PUT /identity/v3/projects/9eeed0fe33f7477bad70f7df301ccb06/users/c0ad7f96e46a4fe5beaad5d6e44db936/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:01.092219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.102827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a50f69-c15e-4b26-a621-3d78d1ec5b60 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.131679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:01.152612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:01.184592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.184592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.184592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.184592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.184935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:01.184935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.185073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57153a6a-c03f-43bc-af30-77661f2d466c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.185160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.186325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.186803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.187187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.187494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.188232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.189828 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.194402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1070/2122] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:01.195824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.208348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3509a64-44f0-44f1-a1ce-93293833e2f8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.216816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1053/2123] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:01.216816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.225559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.226251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.226543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.226827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.227843 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.229449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.230206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94621ad-a717-4947-9935-60fef5257534 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.237099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.237829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.238139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.238408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.239155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.241185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.258217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1071/2124] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:01.259979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.272041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce3b57-ea1a-4704-8fb1-51bd9e79662b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.276971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.277867 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.278151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.278486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] PATH_INFO: `/v3/projects/6da233e59a3246099a00c8d31ac9d3e8/users/180b8082d0154fe1b8733328db54689b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.291224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1054/2125] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:01 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:01.292149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.298647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da233e59a3246099a00c8d31ac9d3e8, user_id=180b8082d0154fe1b8733328db54689b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.301573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.328991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1072/2126] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:01 2022] PUT /identity/v3/projects/6da233e59a3246099a00c8d31ac9d3e8/users/180b8082d0154fe1b8733328db54689b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:01.328991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.385835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935a0969-d2ac-4447-ad55-0f659ea152b1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.405183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197906bd-dbee-4948-9599-f324890ada8f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.414299 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.415177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.415472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.415754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.416448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.418518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.447371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1073/2127] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:01 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:01.447371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.457404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f818624-3b17-42bb-a29c-790f7e5af244 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.458774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.459890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.460181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.460518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] PATH_INFO: `/v3/projects/9eeed0fe33f7477bad70f7df301ccb06/users/c0ad7f96e46a4fe5beaad5d6e44db936/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.462536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eeed0fe33f7477bad70f7df301ccb06, user_id=c0ad7f96e46a4fe5beaad5d6e44db936, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.462733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.463497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.463786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.464064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.464792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.465287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.466379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.476686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1055/2128] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:01 2022] PUT /identity/v3/projects/9eeed0fe33f7477bad70f7df301ccb06/users/c0ad7f96e46a4fe5beaad5d6e44db936/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:01.482560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1074/2129] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:01.483902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.487578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.499566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d108e37-865a-418f-ad3b-f72232e464b9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.567244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346dbfd-2ac2-4c84-95b4-a78c23cafa3b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.574906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de9fba-23e4-4df4-b132-b9f4bd6b1518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.575900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9fba-23e4-4df4-b132-b9f4bd6b1518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.576281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9fba-23e4-4df4-b132-b9f4bd6b1518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.576665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de9fba-23e4-4df4-b132-b9f4bd6b1518 admin admin] PATH_INFO: `/v3/projects/6da233e59a3246099a00c8d31ac9d3e8/users/180b8082d0154fe1b8733328db54689b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.576900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1c188-232e-44cc-a9d2-f56705836507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.577643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1c188-232e-44cc-a9d2-f56705836507 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.577964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1c188-232e-44cc-a9d2-f56705836507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.578278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1c188-232e-44cc-a9d2-f56705836507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.579104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1c188-232e-44cc-a9d2-f56705836507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.579218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de9fba-23e4-4df4-b132-b9f4bd6b1518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da233e59a3246099a00c8d31ac9d3e8, user_id=180b8082d0154fe1b8733328db54689b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.582722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1c188-232e-44cc-a9d2-f56705836507 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.583225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de9fba-23e4-4df4-b132-b9f4bd6b1518 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.592544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:01.598316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1075/2130] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:01 2022] PUT /identity/v3/projects/6da233e59a3246099a00c8d31ac9d3e8/users/180b8082d0154fe1b8733328db54689b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:01.600479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:01.604825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f228c-fcdd-4402-981c-6f9bd6732476 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.605189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f228c-fcdd-4402-981c-6f9bd6732476 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.605612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f228c-fcdd-4402-981c-6f9bd6732476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.614271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1056/2131] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:01.615748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32161f-be20-4ebb-92f0-3cadd787a971 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.616042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32161f-be20-4ebb-92f0-3cadd787a971 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.616325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e32161f-be20-4ebb-92f0-3cadd787a971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.654976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9f7f228c-fcdd-4402-981c-6f9bd6732476 None None] MFA Rules not processed for user `c0ad7f96e46a4fe5beaad5d6e44db936`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:01.656452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9f7f228c-fcdd-4402-981c-6f9bd6732476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:01.679482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8e32161f-be20-4ebb-92f0-3cadd787a971 None None] MFA Rules not processed for user `180b8082d0154fe1b8733328db54689b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:01.681033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8e32161f-be20-4ebb-92f0-3cadd787a971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:01.803947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1076/2132] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:01.805671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1057/2133] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:01.818907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32161f-be20-4ebb-92f0-3cadd787a971 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.820693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f228c-fcdd-4402-981c-6f9bd6732476 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.900826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f228c-fcdd-4402-981c-6f9bd6732476 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.901633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e32161f-be20-4ebb-92f0-3cadd787a971 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.907760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.908495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.908686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.908988 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.909206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.909771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.910057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.910334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.911107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.912705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.918575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.920069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.923629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1077/2134] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:01.924549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.927002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:01.930581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1058/2135] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:01.931347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:01.940154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf2c22-d838-4cd1-b15a-93e4c59fd736 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.942016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ee90-cd7c-41c9-ad5d-e80d6d15c130 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:01.944570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b39ce6-bb0b-4074-b022-bc64f18f7cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.945207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39ce6-bb0b-4074-b022-bc64f18f7cbc service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.945488 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39ce6-bb0b-4074-b022-bc64f18f7cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.945761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b39ce6-bb0b-4074-b022-bc64f18f7cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.946780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:01.948183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.948475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.948765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] PATH_INFO: `/v3/projects/cd16dc29f4bf4dd68d6528cc4fee6913/users/e575e9d8fb9d488eb678600aa77751e2/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:01.957610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b39ce6-bb0b-4074-b022-bc64f18f7cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.959140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b39ce6-bb0b-4074-b022-bc64f18f7cbc service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.965823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd16dc29f4bf4dd68d6528cc4fee6913, user_id=e575e9d8fb9d488eb678600aa77751e2, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:01.968520 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:01.975005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1078/2136] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:01 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:01.985861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1059/2137] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:01 2022] PUT /identity/v3/projects/cd16dc29f4bf4dd68d6528cc4fee6913/users/e575e9d8fb9d488eb678600aa77751e2/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:01.997272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e5e61-2356-461c-b35d-fed0a85bc842 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:01.997556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e5e61-2356-461c-b35d-fed0a85bc842 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:01.999176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e5e61-2356-461c-b35d-fed0a85bc842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.030011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-aa6e5e61-2356-461c-b35d-fed0a85bc842 None None] MFA Rules not processed for user `e575e9d8fb9d488eb678600aa77751e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:02.030927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-aa6e5e61-2356-461c-b35d-fed0a85bc842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:02.099993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:02.109685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1079/2138] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:02.122922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:02.177855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e5e61-2356-461c-b35d-fed0a85bc842 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:02.186167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6ce2b-5530-4551-82ba-4facb5a81522 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:02.192011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:02.192804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:02.193089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:02.193533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.203214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:02.204645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:02.216976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1060/2139] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:02.239892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:02.251994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:02.276084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e5e61-2356-461c-b35d-fed0a85bc842 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:02.284330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:02.286059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:02.286345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:02.286621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] PATH_INFO: `/v3/users/efe7984fa361418f8223cb0f7049794c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.288039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe7984fa361418f8223cb0f7049794c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:02.290131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:02.325614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cefec5-1495-4cf0-88e6-f20ecfcdf5d5 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:02.333861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:02.335069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:02.335422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:02.336132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] PATH_INFO: `/v3/users/e575e9d8fb9d488eb678600aa77751e2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.337403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e575e9d8fb9d488eb678600aa77751e2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:02.339697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:02.349166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe7984fa361418f8223cb0f7049794c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.364339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe7984fa361418f8223cb0f7049794c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.364973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe7984fa361418f8223cb0f7049794c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.389226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe7984fa361418f8223cb0f7049794c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.390287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c5e218eb-717f-42d8-a531-affd9705fe01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe7984fa361418f8223cb0f7049794c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.401176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e575e9d8fb9d488eb678600aa77751e2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.402082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e575e9d8fb9d488eb678600aa77751e2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.404874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e575e9d8fb9d488eb678600aa77751e2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.419623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1080/2140] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:02 2022] DELETE /identity/v3/users/efe7984fa361418f8223cb0f7049794c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:02.420689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e575e9d8fb9d488eb678600aa77751e2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.424146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:02.424438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:02.424718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.444366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-65c5c0c3-2886-4d5c-9f5c-0f3f5afb8cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e575e9d8fb9d488eb678600aa77751e2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:02.459597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:02.460978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:02.462134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1061/2141] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:02 2022] DELETE /identity/v3/users/e575e9d8fb9d488eb678600aa77751e2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:02.467033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:02.467451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:02.468182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.492427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:02.497557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:02.542723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1081/2142] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:02.558014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:02.562516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:02.608182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1062/2143] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:02.617568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:02.626740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:02.626740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:02.677565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:02.688883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7531e8-e99b-44b7-b961-4bb6bcc12789 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:02.695021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:02.695760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:02.696117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:02.696474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.714487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:02.715962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:02.727771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962eeef-de01-437b-9a8b-3a7dab6e4926 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:02.730719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1082/2144] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:02.733166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9aa68-439d-4cb4-aebb-0b7b86c18683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:02.734173 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9aa68-439d-4cb4-aebb-0b7b86c18683 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:02.734701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9aa68-439d-4cb4-aebb-0b7b86c18683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:02.735196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9aa68-439d-4cb4-aebb-0b7b86c18683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:02.746465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9aa68-439d-4cb4-aebb-0b7b86c18683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:02.748510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9aa68-439d-4cb4-aebb-0b7b86c18683 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:02.767340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1063/2145] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:14:03.064639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.068925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.104138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46a83b-9c6d-4b3e-868c-3450631ff043 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.112554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:03.114084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.114487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.114937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] PATH_INFO: `/v3/users/d9d03fc440f34e77a8ada5914d077acd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.116584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d03fc440f34e77a8ada5914d077acd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:03.121048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:03.232094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d03fc440f34e77a8ada5914d077acd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.250056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d03fc440f34e77a8ada5914d077acd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.250764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d03fc440f34e77a8ada5914d077acd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.273940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d03fc440f34e77a8ada5914d077acd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.274856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d03fc440f34e77a8ada5914d077acd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.290963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1083/2146] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:03 2022] DELETE /identity/v3/users/d9d03fc440f34e77a8ada5914d077acd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:03.295917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.296425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.296754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.314297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.316466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.320130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:03.321337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.390062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1064/2147] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:03.394151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.395613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.406659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803ca01-fcf3-4849-aca5-9ca338ae7a55 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.407720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e544827-3095-421b-a8c9-765728b45f4b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.412577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:03.413285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:03.413652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.414016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.414142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.414338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] PATH_INFO: `/v3/projects/cd16dc29f4bf4dd68d6528cc4fee6913` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.414449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.414752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] PATH_INFO: `/v3/projects/9e82aab8b24345c8bf844775289be946` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.415690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd16dc29f4bf4dd68d6528cc4fee6913)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:03.415993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e82aab8b24345c8bf844775289be946)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:03.417680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:03.418123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:03.457776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:03.469047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd16dc29f4bf4dd68d6528cc4fee6913', 'request_id': 'req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.469212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e82aab8b24345c8bf844775289be946', 'request_id': 'req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.474969 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd16dc29f4bf4dd68d6528cc4fee6913', 'request_id': 'req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.476496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e82aab8b24345c8bf844775289be946', 'request_id': 'req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.482201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd16dc29f4bf4dd68d6528cc4fee6913', 'request_id': 'req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.482362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e82aab8b24345c8bf844775289be946', 'request_id': 'req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.494427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] The token cache is being invalidate because project 9e82aab8b24345c8bf844775289be946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:03.494725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.495408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.495536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] The token cache is being invalidate because project cd16dc29f4bf4dd68d6528cc4fee6913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:03.495767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.496414 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.497179 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1065/2148] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:03 2022] DELETE /identity/v3/projects/9e82aab8b24345c8bf844775289be946 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:03.498209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1084/2149] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:03 2022] DELETE /identity/v3/projects/cd16dc29f4bf4dd68d6528cc4fee6913 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:03.498389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.499747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.504400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.504400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.564014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b62b23-dcc7-4bdf-b0f8-bf1b9d2117b4 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.569783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23b028-9a7e-4920-911b-d844b87ce945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:03.570447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b028-9a7e-4920-911b-d844b87ce945 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.570736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b028-9a7e-4920-911b-d844b87ce945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.571080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23b028-9a7e-4920-911b-d844b87ce945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.574175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fe23b028-9a7e-4920-911b-d844b87ce945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.575641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e3ca-a31f-4f47-8646-e6e7ae96a487 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.581114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:03.636202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:03.637179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.637608 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.637786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] PATH_INFO: `/v3/users/c0ad7f96e46a4fe5beaad5d6e44db936` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.639040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ad7f96e46a4fe5beaad5d6e44db936)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:03.640965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:03.660298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23b028-9a7e-4920-911b-d844b87ce945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:03.662252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe23b028-9a7e-4920-911b-d844b87ce945 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:03.673931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1066/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:03.676199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8cec-fb6c-4961-a8b0-c154fa797aff None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.676522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8cec-fb6c-4961-a8b0-c154fa797aff None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.676804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8cec-fb6c-4961-a8b0-c154fa797aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.692362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ad7f96e46a4fe5beaad5d6e44db936'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.701029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4fde8cec-fb6c-4961-a8b0-c154fa797aff None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:03.702129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ad7f96e46a4fe5beaad5d6e44db936'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.702732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4fde8cec-fb6c-4961-a8b0-c154fa797aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.703267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ad7f96e46a4fe5beaad5d6e44db936'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.716203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1067/2151] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:03.725713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568212e8-556d-4560-aa33-1150941dcfcf None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.726313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568212e8-556d-4560-aa33-1150941dcfcf None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.727000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568212e8-556d-4560-aa33-1150941dcfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.729051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ad7f96e46a4fe5beaad5d6e44db936'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.730086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ad7f96e46a4fe5beaad5d6e44db936'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:03.731672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:03.751615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1085/2152] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:03 2022] DELETE /identity/v3/users/c0ad7f96e46a4fe5beaad5d6e44db936 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:03.758344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-568212e8-556d-4560-aa33-1150941dcfcf None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:03.759736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-568212e8-556d-4560-aa33-1150941dcfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.873578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1068/2153] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:03.877890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.893015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99530bf0-aeba-4c37-ac23-4987e42f4c21 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.898297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:03.899049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.899259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.899542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.900557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:03.900796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:03.902406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:03.919866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1086/2154] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:14:03.921230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568212e8-556d-4560-aa33-1150941dcfcf None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.930960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568212e8-556d-4560-aa33-1150941dcfcf None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.935936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:03.936630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:03.936918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:03.937196 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:03.937902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:03.939853 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:03.968496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:03.970717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:03.990475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86267d-4c49-4ea1-adef-882207091da4 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:03.991605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1069/2155] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:03 2022] POST /identity/v3/projects => generated 361 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:03.995675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.071356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.075082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.075421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.075778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] PATH_INFO: `/v3/users/63bb8c804b0c4ef5a4c94888fa5d54e3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.077194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bb8c804b0c4ef5a4c94888fa5d54e3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.079269 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.091160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee7a6a-2c5c-4d10-8a6d-1e8bc6d8d669 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.097028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.098370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.098657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.098970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.099678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.102094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.143040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1070/2156] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:03 2022] POST /identity/v3/users => generated 281 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:14:04.144497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.146192 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.153751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bb8c804b0c4ef5a4c94888fa5d54e3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.156545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:04.163355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fba7d8-d617-463a-91ec-3bc843237cbe admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.166133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bb8c804b0c4ef5a4c94888fa5d54e3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.167028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bb8c804b0c4ef5a4c94888fa5d54e3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.170027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.171122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.171832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.172290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] PATH_INFO: `/v3/projects/89a94e49889447ff8c570dd60df1b5c9` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.173686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a94e49889447ff8c570dd60df1b5c9)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.175678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.181146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bb8c804b0c4ef5a4c94888fa5d54e3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.182031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bb8c804b0c4ef5a4c94888fa5d54e3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.196496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1087/2157] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:03 2022] DELETE /identity/v3/users/63bb8c804b0c4ef5a4c94888fa5d54e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:04.197347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.199014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.242071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a94e49889447ff8c570dd60df1b5c9', 'request_id': 'req-58cc850f-695a-4662-9e8e-ff146ce04cd8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.255037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a94e49889447ff8c570dd60df1b5c9', 'request_id': 'req-58cc850f-695a-4662-9e8e-ff146ce04cd8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.264212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a94e49889447ff8c570dd60df1b5c9', 'request_id': 'req-58cc850f-695a-4662-9e8e-ff146ce04cd8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.270790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:04.277008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e1be3-0756-4dff-bf03-bc1721a10579 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.287321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] The token cache is being invalidate because project 89a94e49889447ff8c570dd60df1b5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:04.288078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.290934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.292951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1071/2158] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:04 2022] DELETE /identity/v3/projects/89a94e49889447ff8c570dd60df1b5c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:04.294085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.295788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.375804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.376752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.377116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.377312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] PATH_INFO: `/v3/projects/9eeed0fe33f7477bad70f7df301ccb06` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.378680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eeed0fe33f7477bad70f7df301ccb06)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.380625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.384187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc850f-695a-4662-9e8e-ff146ce04cd8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.389495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c490d7-6a7b-4ea6-8e5d-6adfb24d51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.390649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c490d7-6a7b-4ea6-8e5d-6adfb24d51b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.391037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c490d7-6a7b-4ea6-8e5d-6adfb24d51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.391386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c490d7-6a7b-4ea6-8e5d-6adfb24d51b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.392285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c490d7-6a7b-4ea6-8e5d-6adfb24d51b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.393884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c490d7-6a7b-4ea6-8e5d-6adfb24d51b4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.404742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1072/2159] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:04.405976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.406271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.406550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.427024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:04.428221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.437904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eeed0fe33f7477bad70f7df301ccb06', 'request_id': 'req-3207e629-e333-47bc-9399-6b4267b6acc2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.444176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eeed0fe33f7477bad70f7df301ccb06', 'request_id': 'req-3207e629-e333-47bc-9399-6b4267b6acc2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.451274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eeed0fe33f7477bad70f7df301ccb06', 'request_id': 'req-3207e629-e333-47bc-9399-6b4267b6acc2'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.467057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] The token cache is being invalidate because project 9eeed0fe33f7477bad70f7df301ccb06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:04.467576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.468400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.470402 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1088/2160] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:04 2022] DELETE /identity/v3/projects/9eeed0fe33f7477bad70f7df301ccb06 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:04.471554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.472860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.500926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1073/2161] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:04.500926 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.502659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.520552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bb10a-7e26-4eb3-b740-593ff93b67b5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.527647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76386e-3c0d-410a-aa79-761c7646eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.528659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76386e-3c0d-410a-aa79-761c7646eb3b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.528955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76386e-3c0d-410a-aa79-761c7646eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.529224 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76386e-3c0d-410a-aa79-761c7646eb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.529965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76386e-3c0d-410a-aa79-761c7646eb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.531596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76386e-3c0d-410a-aa79-761c7646eb3b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.545126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1074/2162] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:04.545126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.545126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.545126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.545630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207e629-e333-47bc-9399-6b4267b6acc2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.550874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.552627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.552915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.553325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] PATH_INFO: `/v3/users/180b8082d0154fe1b8733328db54689b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.554615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=180b8082d0154fe1b8733328db54689b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.556631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.562207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:04.563483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.572982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1075/2163] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:04.574028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.580432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.593547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:04.603058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:04.618590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180b8082d0154fe1b8733328db54689b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.639720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180b8082d0154fe1b8733328db54689b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.640399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180b8082d0154fe1b8733328db54689b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.653781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180b8082d0154fe1b8733328db54689b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.654574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180b8082d0154fe1b8733328db54689b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:04.657472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0699-a683-49ca-aa95-55c94e430b3c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.661378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b350b-acb3-46d1-a7b8-4716223e2b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.662030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b350b-acb3-46d1-a7b8-4716223e2b02 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.662314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b350b-acb3-46d1-a7b8-4716223e2b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.662734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b350b-acb3-46d1-a7b8-4716223e2b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.664766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-203b350b-acb3-46d1-a7b8-4716223e2b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.668549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1089/2164] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:04 2022] DELETE /identity/v3/users/180b8082d0154fe1b8733328db54689b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:04.669133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.670438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.681527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b350b-acb3-46d1-a7b8-4716223e2b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.683499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b350b-acb3-46d1-a7b8-4716223e2b02 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.699118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1076/2165] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:04.700424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8479-cfd5-4354-bb8b-a89103291ed2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.700707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8479-cfd5-4354-bb8b-a89103291ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.700986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f8479-cfd5-4354-bb8b-a89103291ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.722565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d63f8479-cfd5-4354-bb8b-a89103291ed2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:04.724166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d63f8479-cfd5-4354-bb8b-a89103291ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.754915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4868c53-ce75-434b-bc9b-d4ffbc8c3f28 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.759496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59e050-7443-4629-a40e-3c2ee760eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.760398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59e050-7443-4629-a40e-3c2ee760eb01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.760681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59e050-7443-4629-a40e-3c2ee760eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.760954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59e050-7443-4629-a40e-3c2ee760eb01 admin admin] PATH_INFO: `/v3/projects/e3405510ab5f4dfba9870e58fce571d4/users/de638325934d447fb04a841a1528a545/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.777505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59e050-7443-4629-a40e-3c2ee760eb01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3405510ab5f4dfba9870e58fce571d4, user_id=de638325934d447fb04a841a1528a545, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.780452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59e050-7443-4629-a40e-3c2ee760eb01 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.806671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1077/2166] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:04.813104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1090/2167] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:04 2022] PUT /identity/v3/projects/e3405510ab5f4dfba9870e58fce571d4/users/de638325934d447fb04a841a1528a545/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:04.813424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f8479-cfd5-4354-bb8b-a89103291ed2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.822053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44033f-648b-4d8c-87be-4c87b39285e0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.822369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44033f-648b-4d8c-87be-4c87b39285e0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.822649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec44033f-648b-4d8c-87be-4c87b39285e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.833470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f8479-cfd5-4354-bb8b-a89103291ed2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.894376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ec44033f-648b-4d8c-87be-4c87b39285e0 None None] MFA Rules not processed for user `de638325934d447fb04a841a1528a545`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:04.898991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec44033f-648b-4d8c-87be-4c87b39285e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:04.917931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.918626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.918947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.919230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.919976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:04.920473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.922116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:04.951991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1078/2168] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:04.953506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:04.971979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adafbc-4103-4ab3-951f-0540cf6f379b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:04.979097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:04.979983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:04.980422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:04.980854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:04.982054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:04.984155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.000093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1091/2169] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:05.028522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1079/2170] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:04 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:05.032320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44033f-648b-4d8c-87be-4c87b39285e0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.044285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec44033f-648b-4d8c-87be-4c87b39285e0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.071399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:05.147549 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.149197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.150246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.150395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.150823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.151123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.152260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.154887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.182255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1092/2171] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:05.186467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.189544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:05.200223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e082-d3e3-4ac4-8085-a699e7f49d79 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.207647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.208098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.208383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.208663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.210181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.213002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.230182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1093/2172] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:05.232098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.244202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36baf8c3-4e85-406a-8adf-483b6add7908 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.249626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.249759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e1806-1d1a-4784-97a3-6b77e63393ee admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.250395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.250751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.251217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.253062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.254911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.255407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.256427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.257004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.257859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.281057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1094/2173] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:05.281057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.281057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.294710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1eedb9-6904-4dda-90c5-a005260b5542 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.309129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.314698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.315059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.315505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] PATH_INFO: `/v3/projects/6da233e59a3246099a00c8d31ac9d3e8` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.317288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da233e59a3246099a00c8d31ac9d3e8)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.319818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.334930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.336528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.351515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1080/2174] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:14:05.352373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.368920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49f992-df83-4166-bfab-db8cf7901347 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.375193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.376533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.376840 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.377110 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] PATH_INFO: `/v3/projects/6d4bbf7194bd49f18f9fc4621770be93/users/f7675a7bdddd441cbb87442e7911dead/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.400046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d4bbf7194bd49f18f9fc4621770be93, user_id=f7675a7bdddd441cbb87442e7911dead, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.402729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.408061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da233e59a3246099a00c8d31ac9d3e8', 'request_id': 'req-b9460593-c6c8-4689-a3b8-dc76839ed2f7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.421903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1081/2175] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:05 2022] PUT /identity/v3/projects/6d4bbf7194bd49f18f9fc4621770be93/users/f7675a7bdddd441cbb87442e7911dead/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:05.423186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.424882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.429220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da233e59a3246099a00c8d31ac9d3e8', 'request_id': 'req-b9460593-c6c8-4689-a3b8-dc76839ed2f7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.437261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da233e59a3246099a00c8d31ac9d3e8', 'request_id': 'req-b9460593-c6c8-4689-a3b8-dc76839ed2f7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.455145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] The token cache is being invalidate because project 6da233e59a3246099a00c8d31ac9d3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:05.455480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.456108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.457730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1095/2176] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:05 2022] DELETE /identity/v3/projects/6da233e59a3246099a00c8d31ac9d3e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:05.462772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.464797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.516382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0140f02-43b1-407e-9d42-a9fa20cf2619 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.522476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.523754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.524044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.524319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] PATH_INFO: `/v3/projects/5d96887abe874566977681d461d96520` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.525699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d96887abe874566977681d461d96520)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.527945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.553542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9460593-c6c8-4689-a3b8-dc76839ed2f7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.560019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.560974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.561323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.561612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] PATH_INFO: `/v3/users/de638325934d447fb04a841a1528a545` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.562995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de638325934d447fb04a841a1528a545)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.566864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.590050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:05.600516 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d96887abe874566977681d461d96520', 'request_id': 'req-0148aef7-c016-4c2b-aab8-9dff03033d91'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.605127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:05.614124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d96887abe874566977681d461d96520', 'request_id': 'req-0148aef7-c016-4c2b-aab8-9dff03033d91'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.628243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d96887abe874566977681d461d96520', 'request_id': 'req-0148aef7-c016-4c2b-aab8-9dff03033d91'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.639379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de638325934d447fb04a841a1528a545'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.642394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] The token cache is being invalidate because project 5d96887abe874566977681d461d96520 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:05.642613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.643344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0148aef7-c016-4c2b-aab8-9dff03033d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.645442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1082/2177] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:05 2022] DELETE /identity/v3/projects/5d96887abe874566977681d461d96520 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:05.646748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b36a-7c4b-4ffd-b3a1-27375f9d0586 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.647076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b36a-7c4b-4ffd-b3a1-27375f9d0586 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.647394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b36a-7c4b-4ffd-b3a1-27375f9d0586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.654491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de638325934d447fb04a841a1528a545'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.655081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de638325934d447fb04a841a1528a545'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.669787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de638325934d447fb04a841a1528a545'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.670427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-57f456e9-c37e-4619-a389-e9a1efdbd5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de638325934d447fb04a841a1528a545'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:05.680181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f358b36a-7c4b-4ffd-b3a1-27375f9d0586 None None] MFA Rules not processed for user `f7675a7bdddd441cbb87442e7911dead`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:05.681536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f358b36a-7c4b-4ffd-b3a1-27375f9d0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.684777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1096/2178] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:05 2022] DELETE /identity/v3/users/de638325934d447fb04a841a1528a545 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:05.686069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41694db-6771-4551-b163-389d5035c4f6 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.686418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41694db-6771-4551-b163-389d5035c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.686647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41694db-6771-4551-b163-389d5035c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.708433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e41694db-6771-4551-b163-389d5035c4f6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:05.710166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e41694db-6771-4551-b163-389d5035c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.771015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1083/2179] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:05.772541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.773124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.773811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.787549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1097/2180] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:05.796412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e53f-4413-41ad-acdc-5081e5470c24 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.796964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e53f-4413-41ad-acdc-5081e5470c24 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.797319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4e53f-4413-41ad-acdc-5081e5470c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.798393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:05.799820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.814833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1084/2181] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:05.814833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.816891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.818223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7db4e53f-4413-41ad-acdc-5081e5470c24 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:05.825755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7db4e53f-4413-41ad-acdc-5081e5470c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.829153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1098/2182] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:05.830362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14034-491c-4047-926d-0d43a521cbc0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.830727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14034-491c-4047-926d-0d43a521cbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.831124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e14034-491c-4047-926d-0d43a521cbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.840873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641ab75-37c8-4152-9450-dc038c96f910 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.847097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.848316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.848605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.848915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.850041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.852175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.855583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-05e14034-491c-4047-926d-0d43a521cbc0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:05.856993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-05e14034-491c-4047-926d-0d43a521cbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.867653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1099/2183] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:05.872397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063867-70a0-46cf-8af0-26a9c362012c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.872842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063867-70a0-46cf-8af0-26a9c362012c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.873228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f063867-70a0-46cf-8af0-26a9c362012c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.882913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1085/2184] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/projects => generated 369 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:05.885313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.887380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.894954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6f063867-70a0-46cf-8af0-26a9c362012c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:05.896226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6f063867-70a0-46cf-8af0-26a9c362012c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:05.962831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9f2c4-1130-4844-91d2-80665ec7a3cd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.964229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1100/2185] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:05.967059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.967763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.968053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.968364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.968892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063867-70a0-46cf-8af0-26a9c362012c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:05.978243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.979458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f063867-70a0-46cf-8af0-26a9c362012c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:05.979940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.984200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:05.984829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:05.985113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:05.985375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:05.986117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:05.986430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:05.988106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:05.991732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1086/2186] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:06.008545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.008643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1101/2187] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:06.008643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.015624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f08afb-602c-4e12-ba86-d5a6c07e848f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.020737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57089706-ddd2-41cf-b60f-d72d7dd08abb service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.021080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.021680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.021968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.022244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.023068 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:06.023517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.025186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.028013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:06.029834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.030729 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.031494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.031865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.032944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.036731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.039888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1102/2188] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:06.040750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.056104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dc824-0000-46a6-ad0d-d72ab955bea9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.062599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.063299 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.063586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.063864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.064559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.067603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.072768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1087/2189] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:05 2022] POST /identity/v3/users => generated 291 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:06.074518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.105339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1103/2190] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:06 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:06.105921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d016b84-d5da-4e4d-9b71-7bd300aec730 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.106026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.143915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:06.231336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.232030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.232369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.232641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.233355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.235405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.252913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad4fdc-d3ba-4211-a28e-305f1c90767c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.263126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.263855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.264179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.264497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.265255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.267918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.286335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1104/2191] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:06.286335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.286985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1088/2192] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:06 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:06.288174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.299487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d34ba-50b1-4ed1-9b74-269888c846a1 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.371003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f147345-b89a-4f0a-977f-0ba69d1eadd6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.377095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.378012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.378916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.379180 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] PATH_INFO: `/v3/projects/6407807442204fd2bb972700a987ae10/users/25eda4c0ea10480a9eefa213f4820ef5/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.401706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6407807442204fd2bb972700a987ae10, user_id=25eda4c0ea10480a9eefa213f4820ef5, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.406971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.418370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.419342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.419476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.419863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.420606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.422636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.425736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1089/2193] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:06 2022] PUT /identity/v3/projects/6407807442204fd2bb972700a987ae10/users/25eda4c0ea10480a9eefa213f4820ef5/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:06.426602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.451393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1105/2194] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:06 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:06.451393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.453047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:06.472051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730342d-3703-4058-ad3d-6c00e48157fd admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.516847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6dd79-5935-41b9-b9b5-f2af8a6142ad admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.521983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.522882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.523332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.523624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.524330 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.526258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.547932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1090/2195] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:06 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:06.549144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.552952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.553960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.554250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.554535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] PATH_INFO: `/v3/projects/e3405510ab5f4dfba9870e58fce571d4` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.555973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3405510ab5f4dfba9870e58fce571d4)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.558187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.559977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:06.564548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012cc86f-bf29-4e93-8df4-aa80471aa9f3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.570576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.571249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.571531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.571999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.572778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.574499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.587315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1091/2196] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:06.587315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.599489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ded7dda-70bb-43b2-bf4b-5b764e09f43a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.604360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.605026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.605431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.605712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.606596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.608352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.624863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1092/2197] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:06.624863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.632365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:06.636444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c61b8c6-a283-4f48-a246-f6172c731e3c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.645118 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3405510ab5f4dfba9870e58fce571d4', 'request_id': 'req-94336a96-8deb-40cd-8ed0-52d0c8202052'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:06.651107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3405510ab5f4dfba9870e58fce571d4', 'request_id': 'req-94336a96-8deb-40cd-8ed0-52d0c8202052'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:06.660791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3405510ab5f4dfba9870e58fce571d4', 'request_id': 'req-94336a96-8deb-40cd-8ed0-52d0c8202052'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:06.679505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] The token cache is being invalidate because project e3405510ab5f4dfba9870e58fce571d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:06.679931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:06.680709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:06.683493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1106/2198] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:06 2022] DELETE /identity/v3/projects/e3405510ab5f4dfba9870e58fce571d4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:06.684187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.685524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:06.753846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.754788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.755207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.755584 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.756428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.760036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.763654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94336a96-8deb-40cd-8ed0-52d0c8202052 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.769997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361af4e8-2993-4fb9-9c96-c44b0d0ab6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.770938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361af4e8-2993-4fb9-9c96-c44b0d0ab6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.771223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361af4e8-2993-4fb9-9c96-c44b0d0ab6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.771644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361af4e8-2993-4fb9-9c96-c44b0d0ab6b1 admin admin] PATH_INFO: `/v3/projects/6407807442204fd2bb972700a987ae10/users/25eda4c0ea10480a9eefa213f4820ef5/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.777235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361af4e8-2993-4fb9-9c96-c44b0d0ab6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6407807442204fd2bb972700a987ae10, user_id=25eda4c0ea10480a9eefa213f4820ef5, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.777382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1093/2199] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:06.777382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.777550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361af4e8-2993-4fb9-9c96-c44b0d0ab6b1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.777660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:06.792976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa462d-3671-4cc1-86d2-d696cd6a5489 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.795838 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1107/2200] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:06 2022] PUT /identity/v3/projects/6407807442204fd2bb972700a987ae10/users/25eda4c0ea10480a9eefa213f4820ef5/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:06.802287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed24e-d0df-43b9-bde4-ab7d6840da35 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.802733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed24e-d0df-43b9-bde4-ab7d6840da35 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.803409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efed24e-d0df-43b9-bde4-ab7d6840da35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.823098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0efed24e-d0df-43b9-bde4-ab7d6840da35 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:06.826789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0efed24e-d0df-43b9-bde4-ab7d6840da35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:06.854813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.855634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.856535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.856535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.857025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.858681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.870365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1094/2201] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:06.871231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.874571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:06.886742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4394bd-2d0b-473a-bedc-af6430ffeb26 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.891698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.892379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.894123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.894123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.894123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.895569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.907150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1108/2202] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:06.908837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324b6f5-7217-456b-a8b1-ad47ac83a95d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.909352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324b6f5-7217-456b-a8b1-ad47ac83a95d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.910013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1095/2203] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:06.910611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324b6f5-7217-456b-a8b1-ad47ac83a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.910731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:06.928033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f76ad0-607c-469a-9014-818468d7483d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:06.933123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b52065-4dc2-40c7-8243-2575a67744c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:06.934444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b52065-4dc2-40c7-8243-2575a67744c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.934682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b52065-4dc2-40c7-8243-2575a67744c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.935099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b52065-4dc2-40c7-8243-2575a67744c9 admin admin] PATH_INFO: `/v3/projects/a47d190f137a4c1b8e39afd364729ff5/users/5150415ce52b4cc99c0d53f8de59ac0c/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.946220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b324b6f5-7217-456b-a8b1-ad47ac83a95d None None] MFA Rules not processed for user `25eda4c0ea10480a9eefa213f4820ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:06.947801 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b324b6f5-7217-456b-a8b1-ad47ac83a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:06.952723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b52065-4dc2-40c7-8243-2575a67744c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a47d190f137a4c1b8e39afd364729ff5, user_id=5150415ce52b4cc99c0d53f8de59ac0c, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:06.955701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b52065-4dc2-40c7-8243-2575a67744c9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:06.962364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:06.970762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1096/2204] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:06 2022] PUT /identity/v3/projects/a47d190f137a4c1b8e39afd364729ff5/users/5150415ce52b4cc99c0d53f8de59ac0c/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:06.973214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695cce5-bbe6-464c-a667-17a465f0d394 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:06.973837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695cce5-bbe6-464c-a667-17a465f0d394 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:06.974194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695cce5-bbe6-464c-a667-17a465f0d394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:06.992473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3695cce5-bbe6-464c-a667-17a465f0d394 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:06.993776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3695cce5-bbe6-464c-a667-17a465f0d394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:07.032225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1109/2205] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:07.033156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324b6f5-7217-456b-a8b1-ad47ac83a95d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.044948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324b6f5-7217-456b-a8b1-ad47ac83a95d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.058881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1097/2206] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:07.060399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead22ee-aa55-48ac-88c2-2049032ed118 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.060765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead22ee-aa55-48ac-88c2-2049032ed118 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.061053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead22ee-aa55-48ac-88c2-2049032ed118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.066884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:07.091075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7ead22ee-aa55-48ac-88c2-2049032ed118 None None] MFA Rules not processed for user `5150415ce52b4cc99c0d53f8de59ac0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:07.092310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7ead22ee-aa55-48ac-88c2-2049032ed118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:07.113596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.114584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.114962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.115313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] PATH_INFO: `/v3/projects/d543417baaeb442aa92e38119aed5ef3/users/a8df1a0c56304667997d3651d4192be0/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.131230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d543417baaeb442aa92e38119aed5ef3, user_id=a8df1a0c56304667997d3651d4192be0, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.134786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.150820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1110/2207] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:07 2022] PUT /identity/v3/projects/d543417baaeb442aa92e38119aed5ef3/users/a8df1a0c56304667997d3651d4192be0/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:07.151521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.153678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:07.167964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1098/2208] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:07.168953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead22ee-aa55-48ac-88c2-2049032ed118 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.185080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead22ee-aa55-48ac-88c2-2049032ed118 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.232337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0aa8-dc39-4295-892e-1196900d034a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.237798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.238460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.238748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.239061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.265589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3c4ef-5342-43fe-9bd6-885538c62842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.266393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3c4ef-5342-43fe-9bd6-885538c62842 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.266682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3c4ef-5342-43fe-9bd6-885538c62842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.266989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3c4ef-5342-43fe-9bd6-885538c62842 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.267727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3c4ef-5342-43fe-9bd6-885538c62842 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:07.268035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3c4ef-5342-43fe-9bd6-885538c62842 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.270267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3c4ef-5342-43fe-9bd6-885538c62842 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.283324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1099/2209] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:07.285267 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f66fc-86f1-4031-b0d2-c13a8fb6ada6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.285672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f66fc-86f1-4031-b0d2-c13a8fb6ada6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.285959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f66fc-86f1-4031-b0d2-c13a8fb6ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.291014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:07.315249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.315803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-177f66fc-86f1-4031-b0d2-c13a8fb6ada6 None None] MFA Rules not processed for user `a8df1a0c56304667997d3651d4192be0`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:07.317195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-177f66fc-86f1-4031-b0d2-c13a8fb6ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:07.317374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.328196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1111/2210] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:07.338631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.360949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97666c-64ac-4325-b944-7a7ed44ece79 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.366659 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.367367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.367660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.367937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.368674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.370658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.403342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1112/2211] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:07 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:07.404542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.411931 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1100/2212] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:07.413040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f66fc-86f1-4031-b0d2-c13a8fb6ada6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.426630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f66fc-86f1-4031-b0d2-c13a8fb6ada6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.444694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:07.483104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c58190-4277-4c10-8219-53b95fe929b9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.487861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.488515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.488793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.489065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.489743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.490133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.490933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.491219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.491504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.491699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.493479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:07.525362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1113/2213] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:07 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:07.525362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.584967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.586701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.598417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f107-58c7-4783-8f66-f739a30ac75b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.603856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.604500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.604792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.605175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.605831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.606906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1101/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:07.607882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.608013 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.629948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee1ebd-0e2a-4ec2-916a-8ce6d9e133f9 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.635266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.636127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.636483 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.636820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.639225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.642336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.647311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1114/2215] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:07 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:07.651305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.663057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb4469-f2b0-43ac-8ba0-0f73a36e75e0 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.668995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.669859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.670257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.670606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.671447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.673419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.680392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1102/2216] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:07 2022] POST /identity/v3/users => generated 286 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:07.681488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.683844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:07.688235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1115/2217] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:07.688235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.700033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef132b71-9f03-437a-9b4b-61f46104bb83 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.709411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.710242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.710534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.711007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.711752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.713954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.727638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1116/2218] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:07.728549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.740108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb96672-90f3-4feb-a79a-b9156679f69c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.745759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.746704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.747066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.747352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] PATH_INFO: `/v3/projects/53a01a3994ad44358413cb3c1b207605/users/2fcce6bae28f4ab999978bbbcecf9c4c/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.761517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:07.767225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a01a3994ad44358413cb3c1b207605, user_id=2fcce6bae28f4ab999978bbbcecf9c4c, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.771654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.777063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b76ac-d926-4b89-bc62-f07fe2f997c0 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.781944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.784296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.784612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.785739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.791283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1117/2219] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:07 2022] PUT /identity/v3/projects/53a01a3994ad44358413cb3c1b207605/users/2fcce6bae28f4ab999978bbbcecf9c4c/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:07.792394 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.867810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.869619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.881440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1103/2220] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:07.882477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.883184 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235f1a2-5a51-405d-9012-2b0072e577b8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.891732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.892663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.892960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.893241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.894019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.896279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea126b-d4c7-4210-9acc-d7ec7f20d1fc service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.896578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.902489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.903647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.903930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.904206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.905264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.907100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.911202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1118/2221] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:07.913143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:07.913431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.918697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1104/2222] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:07.923794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:07.945383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7f2e6-c5d6-4753-8d23-48cf48154b70 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.945815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839dd18-1333-4d28-9bae-b38d8cddb847 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:07.950958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b0cdc-6327-4b2d-a98b-bdab91d69cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.951985 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b0cdc-6327-4b2d-a98b-bdab91d69cad admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.952183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b0cdc-6327-4b2d-a98b-bdab91d69cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.952475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b0cdc-6327-4b2d-a98b-bdab91d69cad admin admin] PATH_INFO: `/v3/projects/53a01a3994ad44358413cb3c1b207605/users/2fcce6bae28f4ab999978bbbcecf9c4c/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.954615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b0cdc-6327-4b2d-a98b-bdab91d69cad admin admin] RBAC: Authorizing `identity:create_grant(project_id=53a01a3994ad44358413cb3c1b207605, user_id=2fcce6bae28f4ab999978bbbcecf9c4c, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.957869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b0cdc-6327-4b2d-a98b-bdab91d69cad admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:07.966181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691fdac-13cc-4049-a482-8172cfbc0131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:07.967369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691fdac-13cc-4049-a482-8172cfbc0131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.968489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691fdac-13cc-4049-a482-8172cfbc0131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.968898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691fdac-13cc-4049-a482-8172cfbc0131 admin admin] PATH_INFO: `/v3/projects/de1d8d078f764029ae85934daf55b6a2/users/5f25f2bd027e4b0089063e0581a1f9af/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.978946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1105/2223] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:07 2022] PUT /identity/v3/projects/53a01a3994ad44358413cb3c1b207605/users/2fcce6bae28f4ab999978bbbcecf9c4c/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:07.981503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced50a5b-72c0-4b7d-b7a6-826392495bda None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:07.982336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced50a5b-72c0-4b7d-b7a6-826392495bda None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:07.982630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced50a5b-72c0-4b7d-b7a6-826392495bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:07.991095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691fdac-13cc-4049-a482-8172cfbc0131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d8d078f764029ae85934daf55b6a2, user_id=5f25f2bd027e4b0089063e0581a1f9af, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:07.995057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691fdac-13cc-4049-a482-8172cfbc0131 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:08.026863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1119/2224] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:07 2022] PUT /identity/v3/projects/de1d8d078f764029ae85934daf55b6a2/users/5f25f2bd027e4b0089063e0581a1f9af/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:08.026863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:08.026863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:08.026863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:08.041083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ced50a5b-72c0-4b7d-b7a6-826392495bda None None] MFA Rules not processed for user `2fcce6bae28f4ab999978bbbcecf9c4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:08.042822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ced50a5b-72c0-4b7d-b7a6-826392495bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:08.049263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:08.051059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:08.138020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1120/2225] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:08.148535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:08.150307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:08.187589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1106/2226] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:08.198682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced50a5b-72c0-4b7d-b7a6-826392495bda None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:08.227058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f0b50-8af8-42ee-a274-c3c236baf13a None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:08.233477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a257a2-7501-4057-a904-bd059e974e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:08.234140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a257a2-7501-4057-a904-bd059e974e86 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:08.234431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a257a2-7501-4057-a904-bd059e974e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:08.234704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a257a2-7501-4057-a904-bd059e974e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:08.260461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a257a2-7501-4057-a904-bd059e974e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:08.261904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a257a2-7501-4057-a904-bd059e974e86 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:08.272072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1121/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:08.293512 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced50a5b-72c0-4b7d-b7a6-826392495bda None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:08.297917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:08.300151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:08.301182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:08.301600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:08.382232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:08.384133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:08.398343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1107/2228] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:14:09.008791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba48c-e792-4492-9474-0dbc0307e3d3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:09.009085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba48c-e792-4492-9474-0dbc0307e3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:09.009379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feba48c-e792-4492-9474-0dbc0307e3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:09.015934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:09.045213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9feba48c-e792-4492-9474-0dbc0307e3d3 None None] MFA Rules not processed for user `5f25f2bd027e4b0089063e0581a1f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:09.046436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9feba48c-e792-4492-9474-0dbc0307e3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:09.153189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1122/2229] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:09.216897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:09.233794 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac142bdc-0644-4489-9ff8-441beaeba82e service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:09.238603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:09.239884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:09.240351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:09.240836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:09.276900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:09.276900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:09.285231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1108/2230] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:10.740750 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122e4f-66bf-47dd-9c4e-6449bf83ad47 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:10.741262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122e4f-66bf-47dd-9c4e-6449bf83ad47 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:10.741341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2122e4f-66bf-47dd-9c4e-6449bf83ad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:10.749104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:10.759140 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c2122e4f-66bf-47dd-9c4e-6449bf83ad47 None None] MFA Rules not processed for user `5f25f2bd027e4b0089063e0581a1f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:10.760343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c2122e4f-66bf-47dd-9c4e-6449bf83ad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:10.760733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebe359-baf7-43fd-9fd4-cfe3163d3e7f service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:10.765548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:10.766459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:10.766754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:10.767059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] PATH_INFO: `/v3/users/a8df1a0c56304667997d3651d4192be0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:10.768265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8df1a0c56304667997d3651d4192be0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:10.770981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:10.772067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1123/2231] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:10.773706 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:10.822341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8df1a0c56304667997d3651d4192be0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:10.823127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8df1a0c56304667997d3651d4192be0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:10.823765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8df1a0c56304667997d3651d4192be0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:10.831149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8df1a0c56304667997d3651d4192be0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:10.843309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8df1a0c56304667997d3651d4192be0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:10.856077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1109/2232] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:10 2022] DELETE /identity/v3/users/a8df1a0c56304667997d3651d4192be0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:10.860599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:10.861350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:10.861350 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:10.880549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:10.881785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:10.948211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1124/2233] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:10.958314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:10.959844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:10.982726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:10.985904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:10.998786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee34dbb-c370-443e-aa2d-7832aa6fa05c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:11.006496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:11.007490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.007936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.008363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] PATH_INFO: `/v3/users/25c94c46e07f479fa75d867dbdeb1f77` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.010261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c94c46e07f479fa75d867dbdeb1f77)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:11.013599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:11.043478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fecb8a-6d91-46b1-9aef-2fe45dcec4e7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:11.048401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:11.049075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.049361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.050700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.062789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:11.064166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:11.078943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1110/2234] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:11.083990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c94c46e07f479fa75d867dbdeb1f77'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.100004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c94c46e07f479fa75d867dbdeb1f77'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.101217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c94c46e07f479fa75d867dbdeb1f77'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.113927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:11.115457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.129560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c94c46e07f479fa75d867dbdeb1f77'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.130371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-bd139a59-c16f-4632-a72d-191c138d26a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c94c46e07f479fa75d867dbdeb1f77'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.133202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170c56-0937-4058-b238-178a8d1a4ee7 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:11.140708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:11.141660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.141948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.142269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] PATH_INFO: `/v3/users/5150415ce52b4cc99c0d53f8de59ac0c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.144764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5150415ce52b4cc99c0d53f8de59ac0c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:11.146122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:11.148147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:11.153987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1125/2235] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:10 2022] DELETE /identity/v3/users/25c94c46e07f479fa75d867dbdeb1f77 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:11.158287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.158629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.158942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.197379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:11.201917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.239282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5150415ce52b4cc99c0d53f8de59ac0c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.240513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5150415ce52b4cc99c0d53f8de59ac0c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.241290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5150415ce52b4cc99c0d53f8de59ac0c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.257337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5150415ce52b4cc99c0d53f8de59ac0c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.287779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9b93aa8f-3054-4e7c-ad91-06a4b3a2f166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5150415ce52b4cc99c0d53f8de59ac0c'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.297613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:11.305905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1126/2236] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:11.327482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1111/2237] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:11 2022] DELETE /identity/v3/users/5150415ce52b4cc99c0d53f8de59ac0c => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:11.327680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:11.329224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.333103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd16b-969f-4822-9098-49915d16315b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.333466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd16b-969f-4822-9098-49915d16315b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.333670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581dd16b-969f-4822-9098-49915d16315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.373886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-581dd16b-969f-4822-9098-49915d16315b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:11.374439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-581dd16b-969f-4822-9098-49915d16315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.468572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bc314-1701-4284-8d5e-70f084a3648c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:11.515171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1112/2238] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:11.516412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd16b-969f-4822-9098-49915d16315b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:11.518252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-581dd16b-969f-4822-9098-49915d16315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.538808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581dd16b-969f-4822-9098-49915d16315b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:11.544035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:11.545241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.545605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.546399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] PATH_INFO: `/v3/projects/d543417baaeb442aa92e38119aed5ef3` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.547292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d543417baaeb442aa92e38119aed5ef3)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:11.549346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:11.608175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:11.608880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.609461 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.609770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.656188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:11.657740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:11.668805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd543417baaeb442aa92e38119aed5ef3', 'request_id': 'req-97048c62-08f5-485d-8818-f252f91543d8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.680758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1127/2239] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:11.681665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:11.693207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd543417baaeb442aa92e38119aed5ef3', 'request_id': 'req-97048c62-08f5-485d-8818-f252f91543d8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.699780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f3ed5-7684-4afd-9524-3e69996f8e69 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:11.703863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd543417baaeb442aa92e38119aed5ef3', 'request_id': 'req-97048c62-08f5-485d-8818-f252f91543d8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.741218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] The token cache is being invalidate because project d543417baaeb442aa92e38119aed5ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:11.741389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.742277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-97048c62-08f5-485d-8818-f252f91543d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:11.748719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1113/2240] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:11 2022] DELETE /identity/v3/projects/d543417baaeb442aa92e38119aed5ef3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:11.756944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.757574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.757574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.799009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:11.804839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.828587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e32aa-b280-4350-a6f6-040f65dc0f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:11.829344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e32aa-b280-4350-a6f6-040f65dc0f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.829863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e32aa-b280-4350-a6f6-040f65dc0f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.829863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e32aa-b280-4350-a6f6-040f65dc0f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.833261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d22e32aa-b280-4350-a6f6-040f65dc0f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.863937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:11.900874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1114/2241] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:11.902565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:11.908078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:11.922281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b2714-9ada-44de-b91b-9bd6b8373290 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:11.929704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:11.931204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.931758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.932283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] PATH_INFO: `/v3/users/f7675a7bdddd441cbb87442e7911dead` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.934081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7675a7bdddd441cbb87442e7911dead)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:11.936742 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:11.938599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e32aa-b280-4350-a6f6-040f65dc0f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:11.940544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e32aa-b280-4350-a6f6-040f65dc0f6a service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:11.954686 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:11.955853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1128/2242] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:11.958323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b187-92b0-4855-b109-0ba18fb45a17 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:11.958805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b187-92b0-4855-b109-0ba18fb45a17 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:11.959340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75b187-92b0-4855-b109-0ba18fb45a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:11.990361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9b75b187-92b0-4855-b109-0ba18fb45a17 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:11.991767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9b75b187-92b0-4855-b109-0ba18fb45a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.003487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1129/2243] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:12.009858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75b187-92b0-4855-b109-0ba18fb45a17 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.041116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75b187-92b0-4855-b109-0ba18fb45a17 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.043193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7675a7bdddd441cbb87442e7911dead'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.043948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7675a7bdddd441cbb87442e7911dead'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.045425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7675a7bdddd441cbb87442e7911dead'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.053093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.053775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.054596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.054905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.055657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:12.056106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.063271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.066296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7675a7bdddd441cbb87442e7911dead'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.086132 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d65174d4-8c32-42d0-966e-3f905615816b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7675a7bdddd441cbb87442e7911dead'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.096481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1130/2244] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:12.101237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.103492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.107411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1115/2245] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:11 2022] DELETE /identity/v3/users/f7675a7bdddd441cbb87442e7911dead => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:12.115191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.115721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.118722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.129254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12364b-652c-422d-931f-900935c352dc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.140793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:12.142031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.240879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1116/2246] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:12.241433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.243513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.245621 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.246401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.246787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.247193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.247990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.250022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.269326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffe0cf-a5e6-4c29-ae36-dbe6196883b6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.276991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.277878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.278165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.278484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] PATH_INFO: `/v3/projects/da1bbfa47c4b4f059241db41c2f71a7b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.279733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1bbfa47c4b4f059241db41c2f71a7b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.281661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.292296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1131/2247] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:12 2022] POST /identity/v3/projects => generated 399 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:12.292296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.296601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.339666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1bbfa47c4b4f059241db41c2f71a7b', 'request_id': 'req-a1f8741e-2afa-4947-bf94-bdde4d5781e9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.350322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1bbfa47c4b4f059241db41c2f71a7b', 'request_id': 'req-a1f8741e-2afa-4947-bf94-bdde4d5781e9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.358965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1bbfa47c4b4f059241db41c2f71a7b', 'request_id': 'req-a1f8741e-2afa-4947-bf94-bdde4d5781e9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.373803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] The token cache is being invalidate because project da1bbfa47c4b4f059241db41c2f71a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:12.374176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.375144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.377087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1117/2248] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:12 2022] DELETE /identity/v3/projects/da1bbfa47c4b4f059241db41c2f71a7b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:12.381307 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.383405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.387109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bb19d-6d46-4542-b54e-a304303965c9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.406954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:12.428853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:12.461249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.461909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.462189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.462459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.464496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.479045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8741e-2afa-4947-bf94-bdde4d5781e9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.483845 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf7a24-8508-4408-be17-b21a96a64c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.484514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf7a24-8508-4408-be17-b21a96a64c11 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.484799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf7a24-8508-4408-be17-b21a96a64c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.485076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf7a24-8508-4408-be17-b21a96a64c11 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.485766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf7a24-8508-4408-be17-b21a96a64c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.487743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf7a24-8508-4408-be17-b21a96a64c11 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.507211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1118/2249] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:12 2022] POST /identity/v3/users => generated 300 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:12.508551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.508844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.509125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.534999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.535215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:12.536440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.536580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.544586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1119/2250] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:12.545361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.545956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1132/2251] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:12.546796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.552032 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.559956 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea443c55-9900-4965-a9c8-07240bd113e3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.562972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c6589-9c93-44bf-9ee7-db1dc21c3994 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.566184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.567121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.567412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.567690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] PATH_INFO: `/v3/projects/a47d190f137a4c1b8e39afd364729ff5` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.569185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a47d190f137a4c1b8e39afd364729ff5)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.569301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea366a9d-2609-4b9b-81cf-e60805872c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.569805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366a9d-2609-4b9b-81cf-e60805872c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.570192 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366a9d-2609-4b9b-81cf-e60805872c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.570576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea366a9d-2609-4b9b-81cf-e60805872c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.570889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.571469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea366a9d-2609-4b9b-81cf-e60805872c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.573627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea366a9d-2609-4b9b-81cf-e60805872c7d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.591784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1133/2252] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:12.591784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.591784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.591784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.615800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:12.617298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.635557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a47d190f137a4c1b8e39afd364729ff5', 'request_id': 'req-0f640822-cdea-448a-a281-3985841e908a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.646170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a47d190f137a4c1b8e39afd364729ff5', 'request_id': 'req-0f640822-cdea-448a-a281-3985841e908a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.653740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a47d190f137a4c1b8e39afd364729ff5', 'request_id': 'req-0f640822-cdea-448a-a281-3985841e908a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.674358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] The token cache is being invalidate because project a47d190f137a4c1b8e39afd364729ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:12.674627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.675659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.680958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1120/2253] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:12 2022] DELETE /identity/v3/projects/a47d190f137a4c1b8e39afd364729ff5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:12.683856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.684081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.724433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1134/2254] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:12.725676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.728281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.744966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea5d01-e78f-452a-8302-a146a0cc60e3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.756226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.757438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.757730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.758028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] PATH_INFO: `/v3/users/2fcce6bae28f4ab999978bbbcecf9c4c` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.771736 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fcce6bae28f4ab999978bbbcecf9c4c)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.779064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.800219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f640822-cdea-448a-a281-3985841e908a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.809337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.810107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.810354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.810641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.811431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.813700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.826130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1121/2255] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:12 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:12.830462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.842612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec134006-d011-4baa-99ec-19d150129d28 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.848544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.849489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.850029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.850202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.851114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:12.851278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.853022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.866618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1122/2256] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:12.867449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.874700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:12.879912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd516093-fa84-4e42-b79c-a26682bd7fdd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:12.882284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fcce6bae28f4ab999978bbbcecf9c4c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.888583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bedbac-8c13-4608-8453-53108528f710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:12.889398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bedbac-8c13-4608-8453-53108528f710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.889719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bedbac-8c13-4608-8453-53108528f710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.889951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bedbac-8c13-4608-8453-53108528f710 admin admin] PATH_INFO: `/v3/projects/e85657478b3c42cf9711b146ebcd8c1c/users/58d2917f65c74ebfa7fd2faea409cf64/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:12.900526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fcce6bae28f4ab999978bbbcecf9c4c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.901532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fcce6bae28f4ab999978bbbcecf9c4c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.915894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:12.925771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fcce6bae28f4ab999978bbbcecf9c4c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.927653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fcce6bae28f4ab999978bbbcecf9c4c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:12.933922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bedbac-8c13-4608-8453-53108528f710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e85657478b3c42cf9711b146ebcd8c1c, user_id=58d2917f65c74ebfa7fd2faea409cf64, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:12.936678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bedbac-8c13-4608-8453-53108528f710 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:12.957255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1135/2257] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:12 2022] DELETE /identity/v3/users/2fcce6bae28f4ab999978bbbcecf9c4c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:12.958098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:12.959779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:12.961563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1123/2258] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:12 2022] PUT /identity/v3/projects/e85657478b3c42cf9711b146ebcd8c1c/users/58d2917f65c74ebfa7fd2faea409cf64/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:12.972430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:12.972733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:12.973020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.021559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] MFA Rules not processed for user `58d2917f65c74ebfa7fd2faea409cf64`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:13.024093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:13.096439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf0f29-6021-4d66-a913-5b35f3b97872 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.106745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.107483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.107771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.108051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.109620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.116392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.155507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1124/2259] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:13.175695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.177770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:13.178871 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1136/2260] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:12 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:13.179325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.182105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:13.301363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b43a-d46c-4517-9df3-65ca6321279f None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.314450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafead1-cbf8-4342-99cb-822069480e5d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.330432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.332277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.334230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.334576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] PATH_INFO: `/v3/projects/6d4bbf7194bd49f18f9fc4621770be93` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.337225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d4bbf7194bd49f18f9fc4621770be93)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.343597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.388976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.389898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.390505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.390505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.433088 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d4bbf7194bd49f18f9fc4621770be93', 'request_id': 'req-81e93554-ec82-41c5-bfd0-6b986920ab7e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.439612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d4bbf7194bd49f18f9fc4621770be93', 'request_id': 'req-81e93554-ec82-41c5-bfd0-6b986920ab7e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.447792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d4bbf7194bd49f18f9fc4621770be93', 'request_id': 'req-81e93554-ec82-41c5-bfd0-6b986920ab7e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.460986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:13.474158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:13.476887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] The token cache is being invalidate because project 6d4bbf7194bd49f18f9fc4621770be93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:13.477457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.478707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.484251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1137/2261] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:13 2022] DELETE /identity/v3/projects/6d4bbf7194bd49f18f9fc4621770be93 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:13.484251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.484251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:13.506447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.508830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.533981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1125/2262] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:14:13.535953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.574700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f022931-17db-4704-871c-7d3027c4e5c5 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.615318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e93554-ec82-41c5-bfd0-6b986920ab7e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.638357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.639384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.640194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.640681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.642422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.644773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.698814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1138/2263] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:13 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:13.699975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.701940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.703422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.704071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.704387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] PATH_INFO: `/v3/users/25eda4c0ea10480a9eefa213f4820ef5` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.706436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25eda4c0ea10480a9eefa213f4820ef5)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.708055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.717448 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54f7ff-9eec-4838-8c40-64152044326f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.723824 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.724637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.724921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.725237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.726076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.728991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.746372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1139/2264] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:13.748271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.767305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cf6762-9fd6-4f94-892f-0facf7d138cb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.783582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.785494 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.787144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.787495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.790526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.792921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.812742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1140/2265] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:13.816866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.824418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:13.834954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25eda4c0ea10480a9eefa213f4820ef5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.836014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25eda4c0ea10480a9eefa213f4820ef5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.837071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25eda4c0ea10480a9eefa213f4820ef5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.859521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25eda4c0ea10480a9eefa213f4820ef5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.863235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01fd61a-9de2-49b1-ba28-e3d8a07a0c8a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:13.879417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:13.880478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:13.880866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:13.881230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] PATH_INFO: `/v3/projects/53a01a3994ad44358413cb3c1b207605` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:13.882987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=53a01a3994ad44358413cb3c1b207605)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:13.885017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:13.891454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25eda4c0ea10480a9eefa213f4820ef5'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:13.914538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1126/2266] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:13 2022] DELETE /identity/v3/users/25eda4c0ea10480a9eefa213f4820ef5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:13.915527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:13.920194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.039293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53a01a3994ad44358413cb3c1b207605', 'request_id': 'req-f281c98c-f0e0-4235-8a5f-d507a3c27dca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.057134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53a01a3994ad44358413cb3c1b207605', 'request_id': 'req-f281c98c-f0e0-4235-8a5f-d507a3c27dca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.058747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a9717-5e8d-4d0d-a773-fbe0a92f5498 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.066514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:14.085322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53a01a3994ad44358413cb3c1b207605', 'request_id': 'req-f281c98c-f0e0-4235-8a5f-d507a3c27dca'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.129548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] The token cache is being invalidate because project 53a01a3994ad44358413cb3c1b207605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:14.130006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.131349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f281c98c-f0e0-4235-8a5f-d507a3c27dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.133230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1141/2267] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:13 2022] DELETE /identity/v3/projects/53a01a3994ad44358413cb3c1b207605 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:14.137693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebe414-0d7e-400d-99ae-5f6730dc7af8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.138222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebe414-0d7e-400d-99ae-5f6730dc7af8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.138566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebe414-0d7e-400d-99ae-5f6730dc7af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.180719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-48ebe414-0d7e-400d-99ae-5f6730dc7af8 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:14.181950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-48ebe414-0d7e-400d-99ae-5f6730dc7af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.194869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53336-053d-4099-9341-a4e12adac5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.196377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53336-053d-4099-9341-a4e12adac5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.197004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53336-053d-4099-9341-a4e12adac5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.197665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53336-053d-4099-9341-a4e12adac5bf admin admin] PATH_INFO: `/v3/projects/ed9ad3e79f45442b9e41cce6f19d11d2/users/8752518799cd41198dbefb88e3237535/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.222027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53336-053d-4099-9341-a4e12adac5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9ad3e79f45442b9e41cce6f19d11d2, user_id=8752518799cd41198dbefb88e3237535, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.225694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f53336-053d-4099-9341-a4e12adac5bf admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.245800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:14.247522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1127/2268] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:13 2022] PUT /identity/v3/projects/ed9ad3e79f45442b9e41cce6f19d11d2/users/8752518799cd41198dbefb88e3237535/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:14.253727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.254037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.254320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.267751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1142/2269] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:14.274340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:14.276305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.276975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22972a-cc5a-4615-9735-0a9ce8a92d1c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.277079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22972a-cc5a-4615-9735-0a9ce8a92d1c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.277325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22972a-cc5a-4615-9735-0a9ce8a92d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.302940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ed22972a-cc5a-4615-9735-0a9ce8a92d1c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:14.304154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ed22972a-cc5a-4615-9735-0a9ce8a92d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.390057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1143/2270] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:14.396158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22972a-cc5a-4615-9735-0a9ce8a92d1c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.403455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1128/2271] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:14.416528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.417972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed22972a-cc5a-4615-9735-0a9ce8a92d1c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.418560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.427703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.430085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.430509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.430882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.431792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:14.432185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.435151 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.452778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1144/2272] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:14.455220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.471618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed8791-79fd-4398-81ed-d20a12c44afc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.477185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.478375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.478375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.478607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.479469 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.482421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.509334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788334a-664c-4a5c-8fb2-a53bb722542d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.514305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.515383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.515733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.516015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.535606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1145/2273] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:14 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:14.538379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.540270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.541459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.558333 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1129/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:14.570022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.571721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.586252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244aa33-45d1-4d82-b90b-5a2d61f25ea8 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.625110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eca52da-1dcb-4f8b-8c72-5275c8828b3b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.630984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:14.636293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.636894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.637183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.637794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.639349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.641288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.674225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.676271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.676388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.676814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1146/2275] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:14 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:14.679382 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] PATH_INFO: `/v3/projects/6407807442204fd2bb972700a987ae10` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.681346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.685883 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6407807442204fd2bb972700a987ae10)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.685883 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.698716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a8030-e269-4cdc-bbc6-451cb33bdaec admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.704349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.705258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.705746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.706226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.707171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.709155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.756768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1147/2276] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:14.759404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.766900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6407807442204fd2bb972700a987ae10', 'request_id': 'req-fd28828e-895e-45e7-af02-845ea0599d99'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.778321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6407807442204fd2bb972700a987ae10', 'request_id': 'req-fd28828e-895e-45e7-af02-845ea0599d99'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.782310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e5d54b-be31-445a-b282-77620cfdab08 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.788448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6407807442204fd2bb972700a987ae10', 'request_id': 'req-fd28828e-895e-45e7-af02-845ea0599d99'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.803262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] The token cache is being invalidate because project 6407807442204fd2bb972700a987ae10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:14.803661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.804441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.806891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1130/2277] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:14 2022] DELETE /identity/v3/projects/6407807442204fd2bb972700a987ae10 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:14.807236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.810887 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.824346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:14.865180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1e4d8-46b5-49e5-b4b1-c2fe25430eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.865907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e4d8-46b5-49e5-b4b1-c2fe25430eca admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.866267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e4d8-46b5-49e5-b4b1-c2fe25430eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.866561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1e4d8-46b5-49e5-b4b1-c2fe25430eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.867483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e4d8-46b5-49e5-b4b1-c2fe25430eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.869056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1e4d8-46b5-49e5-b4b1-c2fe25430eca admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.886441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1148/2278] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:14.887932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.888311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.888596 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.908495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:14.909849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.910885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd28828e-895e-45e7-af02-845ea0599d99 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.915877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.916858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.917109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.917381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] PATH_INFO: `/v3/users/a5d4e1b29a84415ebc2cb399eb4c8c80` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.918714 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1149/2279] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:14.919693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:14.925596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d4e1b29a84415ebc2cb399eb4c8c80)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.927435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:14.928041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.944538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a239b648-2c17-4782-bd31-90ba27e119d3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:14.951150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b068f-104f-4cbd-ba42-6af35c258aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:14.952475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b068f-104f-4cbd-ba42-6af35c258aed admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:14.952761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b068f-104f-4cbd-ba42-6af35c258aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:14.953037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b068f-104f-4cbd-ba42-6af35c258aed admin admin] PATH_INFO: `/v3/projects/dd545cafbc894b4dac6a63d3a922e723/users/ea9b58c2affa4ede921a4f1980e151de/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:14.972782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b068f-104f-4cbd-ba42-6af35c258aed admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd545cafbc894b4dac6a63d3a922e723, user_id=ea9b58c2affa4ede921a4f1980e151de, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:14.975415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b068f-104f-4cbd-ba42-6af35c258aed admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:14.984604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d4e1b29a84415ebc2cb399eb4c8c80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.985733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d4e1b29a84415ebc2cb399eb4c8c80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:14.986542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d4e1b29a84415ebc2cb399eb4c8c80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:15.003073 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1150/2280] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:14 2022] PUT /identity/v3/projects/dd545cafbc894b4dac6a63d3a922e723/users/ea9b58c2affa4ede921a4f1980e151de/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:15.003263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d4e1b29a84415ebc2cb399eb4c8c80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:15.003360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a35b4e-f320-41e3-b0d6-6523ef671388 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.003360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a35b4e-f320-41e3-b0d6-6523ef671388 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.003360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a35b4e-f320-41e3-b0d6-6523ef671388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.014170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:15.019109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-31a35b4e-f320-41e3-b0d6-6523ef671388 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:15.020240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-40bbaa31-e5af-4215-a963-c77cd2da9a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d4e1b29a84415ebc2cb399eb4c8c80'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:15.022806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-31a35b4e-f320-41e3-b0d6-6523ef671388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:15.040639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1131/2281] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:14 2022] DELETE /identity/v3/users/a5d4e1b29a84415ebc2cb399eb4c8c80 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:15.041952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a572434-12d8-4603-9707-8f6ff913dbb8 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.042244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a572434-12d8-4603-9707-8f6ff913dbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.042524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a572434-12d8-4603-9707-8f6ff913dbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.075890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6a572434-12d8-4603-9707-8f6ff913dbb8 None None] MFA Rules not processed for user `ea9b58c2affa4ede921a4f1980e151de`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:15.077614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6a572434-12d8-4603-9707-8f6ff913dbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:15.115533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1151/2282] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:15.120209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.120507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.120941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.144372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:15.145919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:15.165856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1132/2283] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:15.166903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a572434-12d8-4603-9707-8f6ff913dbb8 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.256555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a572434-12d8-4603-9707-8f6ff913dbb8 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.270395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.271933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.277535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1152/2284] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:15.278200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.278298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.278663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.279615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:15.280344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:15.280462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.281825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.303045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1133/2285] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:15.304242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.315222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa34d03-b0ce-46a8-880d-0c680953d836 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.318882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e79f-29da-46a4-9bf4-bc19ad239697 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.323364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.324069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.324365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.324644 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.325432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.327486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.329892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.332781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.333301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.335405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.336282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.344584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.383394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1134/2286] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:15.390665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.395708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:15.405472 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1153/2287] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:15.409950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.450231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:15.491894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:15.527999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584aeec0-1669-413f-b4f9-7c16e547f913 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.560990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b80690-6168-4755-a939-61db932513e9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.578517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.578517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.578517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.578517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.578869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.579571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.612691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1154/2288] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:15.615648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.638292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8beaab5-dbff-47a6-8b76-ff5349a206ab admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.645114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.646123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.646483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.647086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.647883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.650259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.668983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.669995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.670448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.671019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.683326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1155/2289] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/users => generated 293 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:15.685934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.687722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.687973 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.700053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686b56c-2768-441f-935c-cf94d58e3b5c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.704049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1135/2290] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:15.705188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.705630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.706502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.706980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.707343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.708254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.710369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.720119 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7b03-a687-48dd-98fc-64063619fe54 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.724320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1156/2291] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:15.728517 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.730701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.731489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.731771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.732044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.732832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.734525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.742188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d043213-8ab5-48fa-b4cb-da60010cd87b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.747500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1136/2292] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:15.750512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.750512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.750512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.750512 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.751237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.752088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.753371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.764211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ba2b1-cd48-4ebf-94a0-454384427938 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.767353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1157/2293] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:15.769693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.770624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.771098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.771677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.771801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.772691 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.774395 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.782878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8e661-497d-4820-9b03-1f73b0adbbb7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.788780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a6e90-5d35-4a20-8a8f-915f791ff5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.789678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a6e90-5d35-4a20-8a8f-915f791ff5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.789961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a6e90-5d35-4a20-8a8f-915f791ff5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.790235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a6e90-5d35-4a20-8a8f-915f791ff5a9 admin admin] PATH_INFO: `/v3/projects/732f1aba9b0f4aa3bc8f06013d078769/users/8a8c754518ab49e18dff51e524d5ae18/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.791340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1137/2294] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:15.792371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:15.804950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5458d3-acb8-4508-8ff0-641189a773bd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:15.807090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a6e90-5d35-4a20-8a8f-915f791ff5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732f1aba9b0f4aa3bc8f06013d078769, user_id=8a8c754518ab49e18dff51e524d5ae18, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.810025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a6e90-5d35-4a20-8a8f-915f791ff5a9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.810255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be31db-9c77-466d-a8eb-b68cc9a57376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:15.811136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be31db-9c77-466d-a8eb-b68cc9a57376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.811421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be31db-9c77-466d-a8eb-b68cc9a57376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.811700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be31db-9c77-466d-a8eb-b68cc9a57376 admin admin] PATH_INFO: `/v3/projects/1e0542def9fe4b92a91d60097da17b5e/users/b4f4884c3cc94aa7af1af66eb3406bd4/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.832027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be31db-9c77-466d-a8eb-b68cc9a57376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0542def9fe4b92a91d60097da17b5e, user_id=b4f4884c3cc94aa7af1af66eb3406bd4, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:15.833777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1158/2295] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:15 2022] PUT /identity/v3/projects/732f1aba9b0f4aa3bc8f06013d078769/users/8a8c754518ab49e18dff51e524d5ae18/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:15.836139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be31db-9c77-466d-a8eb-b68cc9a57376 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:15.845274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96264b2-e748-4f27-83a2-40115b786df9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.845569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96264b2-e748-4f27-83a2-40115b786df9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.845894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96264b2-e748-4f27-83a2-40115b786df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.856468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1138/2296] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:15 2022] PUT /identity/v3/projects/1e0542def9fe4b92a91d60097da17b5e/users/b4f4884c3cc94aa7af1af66eb3406bd4/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:15.868131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad3371-5d57-4d28-932a-ebd3fa35e4fb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:15.868538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad3371-5d57-4d28-932a-ebd3fa35e4fb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:15.868914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad3371-5d57-4d28-932a-ebd3fa35e4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:15.885569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c96264b2-e748-4f27-83a2-40115b786df9 None None] MFA Rules not processed for user `8a8c754518ab49e18dff51e524d5ae18`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:15.887306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c96264b2-e748-4f27-83a2-40115b786df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:15.904165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-46ad3371-5d57-4d28-932a-ebd3fa35e4fb None None] MFA Rules not processed for user `b4f4884c3cc94aa7af1af66eb3406bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:15.906398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-46ad3371-5d57-4d28-932a-ebd3fa35e4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.000244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1159/2297] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:16.002977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1139/2298] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:16.004915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96264b2-e748-4f27-83a2-40115b786df9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.008176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad3371-5d57-4d28-932a-ebd3fa35e4fb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.075884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:16.091595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:16.105398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad3371-5d57-4d28-932a-ebd3fa35e4fb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.108854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742c36a-3b39-4f7c-a87a-0914303a9ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.109510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c36a-3b39-4f7c-a87a-0914303a9ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.109903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c36a-3b39-4f7c-a87a-0914303a9ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.110275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742c36a-3b39-4f7c-a87a-0914303a9ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.111215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c36a-3b39-4f7c-a87a-0914303a9ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.113407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d742c36a-3b39-4f7c-a87a-0914303a9ee2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.161799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1140/2299] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:14:16.168682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.169176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.169641 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.171006 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96264b2-e748-4f27-83a2-40115b786df9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.227199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] MFA Rules not processed for user `8752518799cd41198dbefb88e3237535`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:16.228761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.252395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.253711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.254215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.254695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.255591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.258283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.296439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1160/2300] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/projects => generated 377 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:16.297686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.331707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1141/2301] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:16.332889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.334335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.350134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9e0e4-7768-497b-b51a-9a75ef67474c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.365855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8246c1-8dec-4836-aa05-84b527b306c9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.372255 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.372929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.373212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.373490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.374174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.376672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.404726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1161/2302] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/users => generated 299 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:16.407946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.412254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.413153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.413684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.413792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] PATH_INFO: `/v3/projects/0c0a8c265f5e483289042fde3daca2e1` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.415151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0a8c265f5e483289042fde3daca2e1)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.418321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.420322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38650055-674a-4ad4-a2ae-d532e86fd90c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.425423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.426099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.426388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.426665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.427426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.429388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.453281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1162/2303] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:16.457378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.458595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.482995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0a8c265f5e483289042fde3daca2e1', 'request_id': 'req-26ab316b-881a-42eb-89c8-81b13562b6ba'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:16.492575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0a8c265f5e483289042fde3daca2e1', 'request_id': 'req-26ab316b-881a-42eb-89c8-81b13562b6ba'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:16.499084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:16.500462 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0a8c265f5e483289042fde3daca2e1', 'request_id': 'req-26ab316b-881a-42eb-89c8-81b13562b6ba'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:16.503942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:16.520056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] The token cache is being invalidate because project 0c0a8c265f5e483289042fde3daca2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:16.520356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:16.521013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:16.522612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1142/2304] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:16 2022] DELETE /identity/v3/projects/0c0a8c265f5e483289042fde3daca2e1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:16.523580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.524187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6d4dcf-c5f0-4ed6-8996-c8cd38a1cc0b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.526948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.585919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.586578 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.586880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.587161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.588938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.601898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ab316b-881a-42eb-89c8-81b13562b6ba admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.606404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.607094 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.607377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.607650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.608371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.609983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.624796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1143/2305] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:16.625734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.627579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.647318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba56d02-96db-44d5-97b3-263bb0f6e4c7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.652645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57755407-3499-4dd3-952f-dad1c0341ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.653697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57755407-3499-4dd3-952f-dad1c0341ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.654297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57755407-3499-4dd3-952f-dad1c0341ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.654648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57755407-3499-4dd3-952f-dad1c0341ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.655538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57755407-3499-4dd3-952f-dad1c0341ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.657545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57755407-3499-4dd3-952f-dad1c0341ba6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.663287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.664638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.669637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1144/2306] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:16.671161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d26f7-c368-4bec-91ca-099d5f6ad560 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.671522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d26f7-c368-4bec-91ca-099d5f6ad560 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.671859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d26f7-c368-4bec-91ca-099d5f6ad560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.673948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1163/2307] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:16.675798 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.686558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c95b2-d134-436a-9ccb-8a299896bc88 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.692824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6a7d26f7-c368-4bec-91ca-099d5f6ad560 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:16.693538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854762e-8dc6-4383-9540-d6ae5cf20367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.694045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6a7d26f7-c368-4bec-91ca-099d5f6ad560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.694631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854762e-8dc6-4383-9540-d6ae5cf20367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.695115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854762e-8dc6-4383-9540-d6ae5cf20367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.695453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854762e-8dc6-4383-9540-d6ae5cf20367 admin admin] PATH_INFO: `/v3/projects/03617fc3725343318871f16a3810b948/users/1d38cbafe0ba416fb6f8ecd345a0883a/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.703067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1145/2308] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:16.703675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d26f7-c368-4bec-91ca-099d5f6ad560 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.720689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854762e-8dc6-4383-9540-d6ae5cf20367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03617fc3725343318871f16a3810b948, user_id=1d38cbafe0ba416fb6f8ecd345a0883a, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.723687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854762e-8dc6-4383-9540-d6ae5cf20367 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.728753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d26f7-c368-4bec-91ca-099d5f6ad560 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.734957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.735768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.736123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.736469 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.737360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.739230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.741215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1164/2309] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:16 2022] PUT /identity/v3/projects/03617fc3725343318871f16a3810b948/users/1d38cbafe0ba416fb6f8ecd345a0883a/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:16.743315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28444-fc8e-43d1-b375-9559c251c341 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.743609 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28444-fc8e-43d1-b375-9559c251c341 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.743966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d28444-fc8e-43d1-b375-9559c251c341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.751500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1146/2310] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:16.752537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.763182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696bef1-fdba-4be1-939c-724a56aef4b3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.771400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f2d28444-fc8e-43d1-b375-9559c251c341 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:16.772815 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f2d28444-fc8e-43d1-b375-9559c251c341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:16.846434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.847175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.847467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.847750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.848498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.850102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.858985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1165/2311] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:16.862193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1147/2312] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:16.862193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.863916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28444-fc8e-43d1-b375-9559c251c341 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.873157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d28444-fc8e-43d1-b375-9559c251c341 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.873917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601372db-544e-4743-ba51-730ebf3d4424 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.879649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.880117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.880540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.880773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.880880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.881049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.881157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] PATH_INFO: `/v3/projects/527aac8053454251b84f7c1306211848/users/920b24f3e4674faa82b5e4c36b29e4ee/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.881323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.882086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:16.882345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.884047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.898125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1166/2313] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:16.898825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527aac8053454251b84f7c1306211848, user_id=920b24f3e4674faa82b5e4c36b29e4ee, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.898935 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.901372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.909241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c185f19-cd04-4264-8648-d7cf4fda0afb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:16.918025 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1148/2314] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:16 2022] PUT /identity/v3/projects/527aac8053454251b84f7c1306211848/users/920b24f3e4674faa82b5e4c36b29e4ee/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:16.919573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f88427-914b-4453-b727-4edefdac82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:16.920543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88427-914b-4453-b727-4edefdac82c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.920895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88427-914b-4453-b727-4edefdac82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.921240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f88427-914b-4453-b727-4edefdac82c1 admin admin] PATH_INFO: `/v3/projects/03617fc3725343318871f16a3810b948/users/1d38cbafe0ba416fb6f8ecd345a0883a/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.923453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f88427-914b-4453-b727-4edefdac82c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03617fc3725343318871f16a3810b948, user_id=1d38cbafe0ba416fb6f8ecd345a0883a, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:16.927536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f88427-914b-4453-b727-4edefdac82c1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:16.928236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:16.935319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:16.943672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1167/2315] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:16 2022] PUT /identity/v3/projects/03617fc3725343318871f16a3810b948/users/1d38cbafe0ba416fb6f8ecd345a0883a/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:16.952625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a026-3b1f-4ef8-aad9-52f930e89001 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:16.953049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a026-3b1f-4ef8-aad9-52f930e89001 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:16.953340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363a026-3b1f-4ef8-aad9-52f930e89001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:16.968919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:16.993678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7363a026-3b1f-4ef8-aad9-52f930e89001 None None] MFA Rules not processed for user `920b24f3e4674faa82b5e4c36b29e4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:16.995711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7363a026-3b1f-4ef8-aad9-52f930e89001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:17.004610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227d463-7145-4b1b-ab4d-41d902d4bce3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.105701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1168/2316] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:17.107189 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e8c14-6e34-4106-9203-2b59348fcb9d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.107628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e8c14-6e34-4106-9203-2b59348fcb9d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.108063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e8c14-6e34-4106-9203-2b59348fcb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.109258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.110302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.110661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.111194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.112069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.114605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.149108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ec4e8c14-6e34-4106-9203-2b59348fcb9d None None] MFA Rules not processed for user `1d38cbafe0ba416fb6f8ecd345a0883a`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:17.150560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ec4e8c14-6e34-4106-9203-2b59348fcb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:17.156724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1149/2317] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:16 2022] POST /identity/v3/projects => generated 375 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:17.156724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.227086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa84fc96-26f0-4929-940f-e92cffce0e72 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.231843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.232514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.232802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.233085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.233809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.235761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.243212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1169/2318] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:17.247828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e8c14-6e34-4106-9203-2b59348fcb9d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.254320 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e8c14-6e34-4106-9203-2b59348fcb9d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.259339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.259997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.260292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.260584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.261263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.263191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.274182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1150/2319] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:17.274182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.276219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:17.286052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1170/2320] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/users => generated 288 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:17.288160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.297816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37295cf-829b-42ef-a4db-47c943334ad2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.332194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:17.338040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd3b30-26a1-4590-bea1-8d9c2d967f09 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.341850 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.342505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.342791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.343108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.344945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:17.348865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:17.356379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.357481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.357767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.358047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.358729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.360726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.381895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1171/2321] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:17.382928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.392776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6658fb-b219-4613-9c45-7090ed6e60fc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.397436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.398089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.398395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.398667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.399419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.401000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.411591 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.412165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1172/2322] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:17.413002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.415979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.423383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2960c46-ca42-4d08-9b73-6a90e0d8de76 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.427050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1151/2323] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:17.427904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.428904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.429648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.430004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.430303 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.431080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.433039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.443332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9edc-deb3-4a66-8355-e81a4a401f57 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.445732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1173/2324] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:17.448637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.449315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.449598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.449899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.450075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.450663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.453045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.459837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69174732-17c7-4fef-a55b-3a8e16d667f9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.464667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.465609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1152/2325] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:17.465861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.466233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.466487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] PATH_INFO: `/v3/projects/cd62306b2636447b902a696eba3defb6/users/3e1bafc6ee924493ac5672665455aa2b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.469872 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.482164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680c747-3352-44d3-a155-e6967185097e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.483977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd62306b2636447b902a696eba3defb6, user_id=3e1bafc6ee924493ac5672665455aa2b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.486729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.486973 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43745-7cc4-4b15-a4a7-9ef2fea5012f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.488388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43745-7cc4-4b15-a4a7-9ef2fea5012f admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.488705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43745-7cc4-4b15-a4a7-9ef2fea5012f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.489106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43745-7cc4-4b15-a4a7-9ef2fea5012f admin admin] PATH_INFO: `/v3/projects/c4fb003407e74981b146a4fcf6699e97/users/9b034742bb6d46388128f081159b825b/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.508261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1174/2326] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:17 2022] PUT /identity/v3/projects/cd62306b2636447b902a696eba3defb6/users/3e1bafc6ee924493ac5672665455aa2b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:17.511948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.514328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43745-7cc4-4b15-a4a7-9ef2fea5012f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fb003407e74981b146a4fcf6699e97, user_id=9b034742bb6d46388128f081159b825b, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.517095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43745-7cc4-4b15-a4a7-9ef2fea5012f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.535775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1153/2327] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:17 2022] PUT /identity/v3/projects/c4fb003407e74981b146a4fcf6699e97/users/9b034742bb6d46388128f081159b825b/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:17.545646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778cbb-80e8-4978-b5f5-fbedbf6eda66 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.545930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778cbb-80e8-4978-b5f5-fbedbf6eda66 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.546203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86778cbb-80e8-4978-b5f5-fbedbf6eda66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.574554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-86778cbb-80e8-4978-b5f5-fbedbf6eda66 None None] MFA Rules not processed for user `9b034742bb6d46388128f081159b825b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:17.576194 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-86778cbb-80e8-4978-b5f5-fbedbf6eda66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:17.594740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7593fb-6bef-49a4-a702-330c94f71739 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.680992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.681775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.682120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.684031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.684809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.686507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.690085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1154/2328] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:17.691332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778cbb-80e8-4978-b5f5-fbedbf6eda66 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.702347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86778cbb-80e8-4978-b5f5-fbedbf6eda66 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.709462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1175/2329] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:14:17.710584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.720637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.721351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.721475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358885a-d278-41b2-9963-2e2dfed323c5 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.722393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.723086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.724892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.727490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc440d-687c-4b48-9bb6-f7a829f930a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.728181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.728580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc440d-687c-4b48-9bb6-f7a829f930a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.728865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc440d-687c-4b48-9bb6-f7a829f930a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.729147 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc440d-687c-4b48-9bb6-f7a829f930a0 admin admin] PATH_INFO: `/v3/projects/cd62306b2636447b902a696eba3defb6/users/3e1bafc6ee924493ac5672665455aa2b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.731694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc440d-687c-4b48-9bb6-f7a829f930a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd62306b2636447b902a696eba3defb6, user_id=3e1bafc6ee924493ac5672665455aa2b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.734365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc440d-687c-4b48-9bb6-f7a829f930a0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.747937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1176/2330] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:17 2022] PUT /identity/v3/projects/cd62306b2636447b902a696eba3defb6/users/3e1bafc6ee924493ac5672665455aa2b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:17.765633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb69cac-a1f6-4f12-a55b-b9347414778f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.770347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb69cac-a1f6-4f12-a55b-b9347414778f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.770654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb69cac-a1f6-4f12-a55b-b9347414778f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.798519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1155/2331] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:17.802498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.808603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4fb69cac-a1f6-4f12-a55b-b9347414778f None None] MFA Rules not processed for user `3e1bafc6ee924493ac5672665455aa2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:17.809849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4fb69cac-a1f6-4f12-a55b-b9347414778f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:17.828407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:17.875510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:17.899119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1177/2332] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:17.907261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb69cac-a1f6-4f12-a55b-b9347414778f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.907770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7e7c7-e42b-451b-9bf5-63b9dcd6b893 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.913687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.914374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.914662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.914993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.917100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.918019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.941228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1156/2333] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:17 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:17.945168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.957361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bafc70-5401-4838-aaad-b45b0e128b33 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.963317 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.963991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.964279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.964586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.965318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.966923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.974292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb69cac-a1f6-4f12-a55b-b9347414778f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.980129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1157/2334] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:14:17.980264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.980264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.980264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.980264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.981695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:17.989011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:17.990477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:17.992153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017fa15a-917f-4702-800e-03244c8bea1c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:17.997047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:17.997688 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:17.997990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:17.998244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:17.999002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.000620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.001270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1178/2335] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:14:18.014589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1158/2336] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:14:18.015768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.027866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71d79b-175e-4636-8f0d-8f7b5c0e48ce service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.034361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a99bda-a029-4da6-a1f6-16b390fd96c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.035563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a99bda-a029-4da6-a1f6-16b390fd96c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.035895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a99bda-a029-4da6-a1f6-16b390fd96c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.035895 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a99bda-a029-4da6-a1f6-16b390fd96c3 admin admin] PATH_INFO: `/v3/projects/3475f437dc4d4969a950a8d1d47c165a/users/a60017be364144d2b30447bc151687ab/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.047701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.049427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:18.051975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a99bda-a029-4da6-a1f6-16b390fd96c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3475f437dc4d4969a950a8d1d47c165a, user_id=a60017be364144d2b30447bc151687ab, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.054643 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a99bda-a029-4da6-a1f6-16b390fd96c3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.061705 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff1d65-0242-476b-9174-31d63c7d8a4e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.068944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1179/2337] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:18 2022] PUT /identity/v3/projects/3475f437dc4d4969a950a8d1d47c165a/users/a60017be364144d2b30447bc151687ab/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:18.080031 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b13af-1a59-4911-ae2b-98f91a4dab46 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.080380 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b13af-1a59-4911-ae2b-98f91a4dab46 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.080667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b13af-1a59-4911-ae2b-98f91a4dab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.109159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ca1b13af-1a59-4911-ae2b-98f91a4dab46 None None] MFA Rules not processed for user `a60017be364144d2b30447bc151687ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:18.110420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ca1b13af-1a59-4911-ae2b-98f91a4dab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:18.117837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.118942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.119409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.119903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.122286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:18.184367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1180/2338] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:18.185959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f411242-4784-4f79-8658-fa885c3ba897 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.186210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f411242-4784-4f79-8658-fa885c3ba897 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.186567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f411242-4784-4f79-8658-fa885c3ba897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.192778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.194238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.205198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6f411242-4784-4f79-8658-fa885c3ba897 None None] MFA Rules not processed for user `8752518799cd41198dbefb88e3237535`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:18.206607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1159/2339] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:14:18.207429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6f411242-4784-4f79-8658-fa885c3ba897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:18.208099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.226074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:18.295092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1181/2340] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:18.299365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:18.305442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e51954-61f2-4e48-989f-545924a712b6 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.312654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.313405 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.313806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.314155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.314991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.317877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.361535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1160/2341] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:18 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:18.366332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f411242-4784-4f79-8658-fa885c3ba897 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.380440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f411242-4784-4f79-8658-fa885c3ba897 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.466525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.467163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.467450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.467741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.468413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.470340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.491817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1182/2342] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:18 2022] POST /identity/v3/users => generated 294 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:18.496272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.514359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c5e0e-5b4a-46cb-99b9-f2fed4749bf2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.520505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.521227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.521560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.521899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.522658 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.524458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.539913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1161/2343] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:14:18.540957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.553499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6efd0c-f662-4f22-9f8d-3133256d3f8b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.558522 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.559445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.559726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.559999 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] PATH_INFO: `/v3/projects/10ad144877ae44d599be4e8bcfd8c5ca/users/5c24b3dfa3784527af089dd3275c50bc/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.587595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ad144877ae44d599be4e8bcfd8c5ca, user_id=5c24b3dfa3784527af089dd3275c50bc, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.590791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.607324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1183/2344] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:18 2022] PUT /identity/v3/projects/10ad144877ae44d599be4e8bcfd8c5ca/users/5c24b3dfa3784527af089dd3275c50bc/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:18.611442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.630238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d91116-f1e9-4e89-a8ca-53d5245d65e5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.708292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6389c26-4bca-4f68-9235-66a340e5f45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.708976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389c26-4bca-4f68-9235-66a340e5f45e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.709262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389c26-4bca-4f68-9235-66a340e5f45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.712096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6389c26-4bca-4f68-9235-66a340e5f45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.712861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6389c26-4bca-4f68-9235-66a340e5f45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.714480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6389c26-4bca-4f68-9235-66a340e5f45e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.725613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1162/2345] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:18.730338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:18.751614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2ccc6-2038-491b-ac90-4286aba656b7 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:18.760087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:18.760863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.760863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.761268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] PATH_INFO: `/v3/projects/10ad144877ae44d599be4e8bcfd8c5ca/users/5c24b3dfa3784527af089dd3275c50bc/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.763574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ad144877ae44d599be4e8bcfd8c5ca, user_id=5c24b3dfa3784527af089dd3275c50bc, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:18.766644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:18.781953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1184/2346] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:18 2022] PUT /identity/v3/projects/10ad144877ae44d599be4e8bcfd8c5ca/users/5c24b3dfa3784527af089dd3275c50bc/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:18.793604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:18.793899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:18.794178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:18.825735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] MFA Rules not processed for user `5c24b3dfa3784527af089dd3275c50bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:18.827468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:18.936728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1163/2347] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:18.952016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:19.048223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:19.049636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:19.074005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08024acf-a598-468e-ab59-f6b95f923382 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:19.086680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:19.087385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:19.088243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:19.088243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:19.163113 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:19.178006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:19.196846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ac802-70d0-4e35-b971-63a41fcd44f7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:19.203118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:19.204068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:19.204265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:19.204401 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:19.204608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] PATH_INFO: `/v3/users/58d2917f65c74ebfa7fd2faea409cf64` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:19.205710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:19.205824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d2917f65c74ebfa7fd2faea409cf64)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:19.208509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:19.215924 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1185/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:19.216881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:19.227784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aa8ed-34db-4ad1-8178-ed26108c3fcc service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:19.232863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:19.233520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:19.233893 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:19.234104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:19.236008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:19.264241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d2917f65c74ebfa7fd2faea409cf64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:19.265771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d2917f65c74ebfa7fd2faea409cf64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:19.266806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d2917f65c74ebfa7fd2faea409cf64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:19.282464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d2917f65c74ebfa7fd2faea409cf64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:19.313403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ede0da20-6545-48db-a4da-35c5e1a8801b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d2917f65c74ebfa7fd2faea409cf64'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:19.330652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1164/2349] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:19 2022] DELETE /identity/v3/users/58d2917f65c74ebfa7fd2faea409cf64 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:19.335993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:19.337030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:19.337392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:19.342412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:19.344223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:19.356398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1186/2350] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:19.363453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:19.366312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:19.449386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1165/2351] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:19.460979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:19.463162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:19.561891 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480cdd3-3408-4500-a5cd-add64ab86ed9 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:19.650313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:19.650313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:19.650664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:19.650912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:19.676270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:19.678314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:19.693726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1187/2352] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:19.987646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:19.991602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:20.012619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1efc60-36d9-4b3a-841f-4b79d1816b8e None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:20.020409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:20.021251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:20.021538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:20.021814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] PATH_INFO: `/v3/projects/e85657478b3c42cf9711b146ebcd8c1c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:20.023108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e85657478b3c42cf9711b146ebcd8c1c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:20.025048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:20.087138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e85657478b3c42cf9711b146ebcd8c1c', 'request_id': 'req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:20.096143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e85657478b3c42cf9711b146ebcd8c1c', 'request_id': 'req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:20.104083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e85657478b3c42cf9711b146ebcd8c1c', 'request_id': 'req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:20.106457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:20.122398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] The token cache is being invalidate because project e85657478b3c42cf9711b146ebcd8c1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:20.123086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:20.124261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:20.127639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1166/2353] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:19 2022] DELETE /identity/v3/projects/e85657478b3c42cf9711b146ebcd8c1c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:20.257705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:20.259949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:20.323124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:20.348020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035833a-7a11-40bf-9bfe-81666c42716d service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:20.397203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:20.397887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:20.398169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:20.398443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:20.400365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:20.467773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:20.469309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:20.482003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1188/2354] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:20 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:20.957761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:20.959190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:20.971304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68ba5f-e5ef-4d54-a13f-6285134f4f84 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:20.974805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cccdaf-2957-4e8e-9a00-58019b303399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:20.975920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cccdaf-2957-4e8e-9a00-58019b303399 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:20.975920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cccdaf-2957-4e8e-9a00-58019b303399 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:20.976104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cccdaf-2957-4e8e-9a00-58019b303399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:20.977795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d8cccdaf-2957-4e8e-9a00-58019b303399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:21.039131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cccdaf-2957-4e8e-9a00-58019b303399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:21.040557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cccdaf-2957-4e8e-9a00-58019b303399 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:21.049436 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1167/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:21.412268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:21.414639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:21.528583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd76a23-13c1-415a-b1c1-fc709e0ab961 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:21.534220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:21.535115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:21.535401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:21.535674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] PATH_INFO: `/v3/users/8a8c754518ab49e18dff51e524d5ae18` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:21.537558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8c754518ab49e18dff51e524d5ae18)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:21.540606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:21.592797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:21.597361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8c754518ab49e18dff51e524d5ae18'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:21.607852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8c754518ab49e18dff51e524d5ae18'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:21.608629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8c754518ab49e18dff51e524d5ae18'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:21.641882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8c754518ab49e18dff51e524d5ae18'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:21.643213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8c754518ab49e18dff51e524d5ae18'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:21.671560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1189/2356] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:21 2022] DELETE /identity/v3/users/8a8c754518ab49e18dff51e524d5ae18 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:21.677919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:21.677919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:21.678455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:21.697044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:21.697780 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:21.764720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:21.766112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:21.779555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1168/2357] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:21.790752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:21.793059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:21.868775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7be95-b5c5-4f3f-affa-607431db7cf6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:21.869919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56ebff-f6e6-4a2e-8e88-21baa2d9204f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:21.874528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:21.875311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:21.875311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:21.875680 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:21.877640 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:21.880593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:21.881678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:21.883234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:21.883707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:21.901410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:21.906558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:21.924145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1169/2358] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:22.010384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:22.012030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:22.024007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1190/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:22.800999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:22.803843 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:22.823243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a421c49-0b68-4d33-a1cb-0fc2281446ad service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:22.830098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:22.831866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:22.832358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:22.832890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] PATH_INFO: `/v3/projects/732f1aba9b0f4aa3bc8f06013d078769` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:22.834403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732f1aba9b0f4aa3bc8f06013d078769)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:22.837743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:22.904855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:22.926882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732f1aba9b0f4aa3bc8f06013d078769', 'request_id': 'req-2acf755f-f827-4c8f-aaec-7e2fb083b784'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:22.944827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732f1aba9b0f4aa3bc8f06013d078769', 'request_id': 'req-2acf755f-f827-4c8f-aaec-7e2fb083b784'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:22.952587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732f1aba9b0f4aa3bc8f06013d078769', 'request_id': 'req-2acf755f-f827-4c8f-aaec-7e2fb083b784'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:22.967223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] The token cache is being invalidate because project 732f1aba9b0f4aa3bc8f06013d078769 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:22.967636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:22.968289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:22.970884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1170/2360] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:22 2022] DELETE /identity/v3/projects/732f1aba9b0f4aa3bc8f06013d078769 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:22.974889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:22.993846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2673f-a9ea-4b89-aab8-e08bfa50eb89 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:23.061410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:23.062300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:23.062582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:23.062878 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] PATH_INFO: `/v3/users/920b24f3e4674faa82b5e4c36b29e4ee` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:23.064104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=920b24f3e4674faa82b5e4c36b29e4ee)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:23.066158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:23.072342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:23.151751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920b24f3e4674faa82b5e4c36b29e4ee'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.161620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920b24f3e4674faa82b5e4c36b29e4ee'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.163242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920b24f3e4674faa82b5e4c36b29e4ee'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.187881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920b24f3e4674faa82b5e4c36b29e4ee'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.191021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920b24f3e4674faa82b5e4c36b29e4ee'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.229476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1191/2361] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:22 2022] DELETE /identity/v3/users/920b24f3e4674faa82b5e4c36b29e4ee => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:23.791879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:23.793894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:23.810803 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf755f-f827-4c8f-aaec-7e2fb083b784 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:23.881647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:23.882521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:23.882802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:23.883341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] PATH_INFO: `/v3/projects/527aac8053454251b84f7c1306211848` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:23.884532 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527aac8053454251b84f7c1306211848)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:23.887147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:23.936653 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527aac8053454251b84f7c1306211848', 'request_id': 'req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.951554 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527aac8053454251b84f7c1306211848', 'request_id': 'req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.958951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527aac8053454251b84f7c1306211848', 'request_id': 'req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.977339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] The token cache is being invalidate because project 527aac8053454251b84f7c1306211848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:23.977725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.978652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:23.980767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1171/2362] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:23 2022] DELETE /identity/v3/projects/527aac8053454251b84f7c1306211848 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:23.984548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:23.986637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:24.001450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376ce7f-4dae-444a-94fa-5f3eed78dd3e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:24.086625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:24.087743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:24.088065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:24.088345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] PATH_INFO: `/v3/users/3e1bafc6ee924493ac5672665455aa2b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:24.089594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e1bafc6ee924493ac5672665455aa2b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:24.091628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:24.143292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e1bafc6ee924493ac5672665455aa2b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.150477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e1bafc6ee924493ac5672665455aa2b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.151119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e1bafc6ee924493ac5672665455aa2b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.165063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e1bafc6ee924493ac5672665455aa2b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.165796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e1bafc6ee924493ac5672665455aa2b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.178975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1192/2363] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:23 2022] DELETE /identity/v3/users/3e1bafc6ee924493ac5672665455aa2b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:24.489149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:24.490719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:24.511948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff88d78-ac18-43e6-ab2d-4de2088b08f6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:24.580496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:24.611569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:24.612495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:24.613027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:24.613536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] PATH_INFO: `/v3/projects/cd62306b2636447b902a696eba3defb6` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:24.615234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd62306b2636447b902a696eba3defb6)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:24.618081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:24.730206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd62306b2636447b902a696eba3defb6', 'request_id': 'req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.737764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:24.739239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:24.742983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd62306b2636447b902a696eba3defb6', 'request_id': 'req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.749177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd62306b2636447b902a696eba3defb6', 'request_id': 'req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.750482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:24.756540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db5635-58ba-4738-9c2d-c0571e61c1be admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:24.767225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] The token cache is being invalidate because project cd62306b2636447b902a696eba3defb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:24.767579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.768842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-bb700e99-d6b6-4362-b1a9-f7ad66ccbed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.770497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1172/2364] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:24 2022] DELETE /identity/v3/projects/cd62306b2636447b902a696eba3defb6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:24.777590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e275e1-d602-4e55-9eaf-21e606091481 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:24.777590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e275e1-d602-4e55-9eaf-21e606091481 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:24.777590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e275e1-d602-4e55-9eaf-21e606091481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:24.797613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-28e275e1-d602-4e55-9eaf-21e606091481 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:24.798752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-28e275e1-d602-4e55-9eaf-21e606091481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:24.828671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:24.829559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:24.829855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:24.830175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] PATH_INFO: `/v3/users/ea9b58c2affa4ede921a4f1980e151de` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:24.832232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9b58c2affa4ede921a4f1980e151de)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:24.834341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:24.880363 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1173/2365] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:24.890303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991512d1-87be-46b2-81a0-4d256eacbb90 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:24.890594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991512d1-87be-46b2-81a0-4d256eacbb90 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:24.890693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9b58c2affa4ede921a4f1980e151de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.890905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991512d1-87be-46b2-81a0-4d256eacbb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:24.901277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9b58c2affa4ede921a4f1980e151de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.902025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9b58c2affa4ede921a4f1980e151de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.914702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-991512d1-87be-46b2-81a0-4d256eacbb90 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:24.915435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9b58c2affa4ede921a4f1980e151de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.916148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-991512d1-87be-46b2-81a0-4d256eacbb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:24.916381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-38a5edb9-92e7-4f30-848c-f745855f60fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9b58c2affa4ede921a4f1980e151de'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:24.926936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1174/2366] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:24.931402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991512d1-87be-46b2-81a0-4d256eacbb90 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:24.934116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1193/2367] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:24 2022] DELETE /identity/v3/users/ea9b58c2affa4ede921a4f1980e151de => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:24.938340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:24.938630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:24.938943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:24.945853 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991512d1-87be-46b2-81a0-4d256eacbb90 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:24.957729 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:24.958951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:25.010052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.011028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.011495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.011958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.012862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:25.013381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.015461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.034316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1175/2368] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:25.035275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.040030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1194/2369] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:25.054009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a8552-84f4-45c0-ab19-cf1ba329098c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.057940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.060100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:25.064898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.066248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.066514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.066817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.067728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.069431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.079002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:25.111498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:25.122746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1176/2370] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:25 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:25.126322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.167223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa62c09-9a81-404b-af4d-fa15015115fd None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.217108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20f16e-658a-48ec-a0e2-1608bab27efe admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.222514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.223193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.223491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.223854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.224606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.226551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.232892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.233933 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.234411 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.234696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.249094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.250599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.256721 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1177/2371] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:25 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:25.261040 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.266875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1195/2372] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:25.272413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4cfac-0bba-44d2-9fbf-c7ad37112e4d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.279161 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.279961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.280256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.280541 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.281290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.282928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.299209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1178/2373] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:14:25.304847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.319784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac7b4-5610-42ec-ae8f-bfd976c10ace service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.328370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e47226-a1f4-4589-9bea-6b67baf25179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.329240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47226-a1f4-4589-9bea-6b67baf25179 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.329527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47226-a1f4-4589-9bea-6b67baf25179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.329808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e47226-a1f4-4589-9bea-6b67baf25179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.330861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e47226-a1f4-4589-9bea-6b67baf25179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.332235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e47226-a1f4-4589-9bea-6b67baf25179 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.349904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1196/2374] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:25.353895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.365058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acbb2-baaf-48a2-9740-f96a3fdddfa1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.370894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.371639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.371999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.372344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] PATH_INFO: `/v3/projects/442aea638c6d4c168f801aa5b1fc8940/users/66ccb4394da24a15a9b791c1c5e893f0/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.398303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442aea638c6d4c168f801aa5b1fc8940, user_id=66ccb4394da24a15a9b791c1c5e893f0, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.401016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.420261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1179/2375] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:25 2022] PUT /identity/v3/projects/442aea638c6d4c168f801aa5b1fc8940/users/66ccb4394da24a15a9b791c1c5e893f0/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:25.433943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023f573-0602-4dde-9899-a84acf640953 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.433943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023f573-0602-4dde-9899-a84acf640953 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.433943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023f573-0602-4dde-9899-a84acf640953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.468823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8023f573-0602-4dde-9899-a84acf640953 None None] MFA Rules not processed for user `66ccb4394da24a15a9b791c1c5e893f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:25.472221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8023f573-0602-4dde-9899-a84acf640953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:25.570391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1197/2376] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:25.584153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.588610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:25.595109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023f573-0602-4dde-9899-a84acf640953 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.598393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8023f573-0602-4dde-9899-a84acf640953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:25.671871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f12464-add8-49d3-8c8b-08f6e19f77c6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.675534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8376ffaa09e2496a80fa60c979769d8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.676204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.676474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.676758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.687277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.688801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.698511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1180/2377] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:25.704769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023f573-0602-4dde-9899-a84acf640953 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.710925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.711308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.711605 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.711978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] PATH_INFO: `/v3/projects/dd545cafbc894b4dac6a63d3a922e723` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.713519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd545cafbc894b4dac6a63d3a922e723)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.715767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:25.720825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:25.772222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd545cafbc894b4dac6a63d3a922e723', 'request_id': 'req-7a7a9402-f073-424d-a4ab-a80956662c83'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:25.780228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd545cafbc894b4dac6a63d3a922e723', 'request_id': 'req-7a7a9402-f073-424d-a4ab-a80956662c83'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:25.793017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd545cafbc894b4dac6a63d3a922e723', 'request_id': 'req-7a7a9402-f073-424d-a4ab-a80956662c83'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:25.813233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] The token cache is being invalidate because project dd545cafbc894b4dac6a63d3a922e723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:25.813796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:25.814746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:25.817673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1198/2378] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:25 2022] DELETE /identity/v3/projects/dd545cafbc894b4dac6a63d3a922e723 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:25.823553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:25.842135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688062a-5a6f-4435-83cd-6bbbc5b2bd16 service glance] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:25.902994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:25.924252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:25.925281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:25.925610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:25.925962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] PATH_INFO: `/v3/users/b4f4884c3cc94aa7af1af66eb3406bd4` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:25.927344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4f4884c3cc94aa7af1af66eb3406bd4)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:25.929497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:26.005536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4f4884c3cc94aa7af1af66eb3406bd4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.006101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4f4884c3cc94aa7af1af66eb3406bd4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.006793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4f4884c3cc94aa7af1af66eb3406bd4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.021755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4f4884c3cc94aa7af1af66eb3406bd4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.040832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-4476245d-43f5-4d7d-a930-e1b5f3981b94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4f4884c3cc94aa7af1af66eb3406bd4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.059841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1181/2379] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:25 2022] DELETE /identity/v3/users/b4f4884c3cc94aa7af1af66eb3406bd4 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:26.199234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:26.201859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:26.223658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7a9402-f073-424d-a4ab-a80956662c83 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:26.324856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:26.328166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:26.328466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:26.328753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] PATH_INFO: `/v3/users/9b034742bb6d46388128f081159b825b` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:26.330559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b034742bb6d46388128f081159b825b)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:26.336718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:26.401206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b034742bb6d46388128f081159b825b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.411981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b034742bb6d46388128f081159b825b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.413230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b034742bb6d46388128f081159b825b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.438990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b034742bb6d46388128f081159b825b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.439854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b034742bb6d46388128f081159b825b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.455280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1199/2380] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:26 2022] DELETE /identity/v3/users/9b034742bb6d46388128f081159b825b => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:26.460479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:26.460783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:26.461104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:26.480808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:26.482027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:26.560640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1182/2381] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:26.570516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:26.573121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:26.579258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:26.580359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:26.590338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed8ea72-97d7-4e77-a6c1-82a4b6e87926 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:26.595311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:26.626960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:26.627337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:26.628178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] PATH_INFO: `/v3/projects/1e0542def9fe4b92a91d60097da17b5e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:26.629610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0542def9fe4b92a91d60097da17b5e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:26.631618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:26.639662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:26.659282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de172aa-783a-4f01-87bf-4b4566a18027 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:26.663493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:26.664138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:26.664422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:26.664700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:26.674297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:26.676327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:26.686970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1183/2382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:26.687389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0542def9fe4b92a91d60097da17b5e', 'request_id': 'req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.696858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0542def9fe4b92a91d60097da17b5e', 'request_id': 'req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.704126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0542def9fe4b92a91d60097da17b5e', 'request_id': 'req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.726363 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] The token cache is being invalidate because project 1e0542def9fe4b92a91d60097da17b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:26.726744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.727497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.729187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1200/2383] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:26 2022] DELETE /identity/v3/projects/1e0542def9fe4b92a91d60097da17b5e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:26.733519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:26.748608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b28d0b-7911-45eb-8d55-581a237d4078 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:26.755613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:26.814523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:26.816007 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:26.816303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:26.816680 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] PATH_INFO: `/v3/users/1d38cbafe0ba416fb6f8ecd345a0883a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:26.817902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d38cbafe0ba416fb6f8ecd345a0883a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:26.819929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:26.877461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d38cbafe0ba416fb6f8ecd345a0883a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.878886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d38cbafe0ba416fb6f8ecd345a0883a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.879628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d38cbafe0ba416fb6f8ecd345a0883a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.888160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d38cbafe0ba416fb6f8ecd345a0883a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.901991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d38cbafe0ba416fb6f8ecd345a0883a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:26.914889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1184/2384] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:26 2022] DELETE /identity/v3/users/1d38cbafe0ba416fb6f8ecd345a0883a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:26.969548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:26.971182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:26.988468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dad95-4206-4f7d-8a98-d2c9197a8bfc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.061753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.062560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.062822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.063128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] PATH_INFO: `/v3/projects/c4fb003407e74981b146a4fcf6699e97` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.064340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fb003407e74981b146a4fcf6699e97)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.066504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.122339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fb003407e74981b146a4fcf6699e97', 'request_id': 'req-613db2b5-7809-48b9-aea6-e324ecd9d4d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.129310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fb003407e74981b146a4fcf6699e97', 'request_id': 'req-613db2b5-7809-48b9-aea6-e324ecd9d4d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.135600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fb003407e74981b146a4fcf6699e97', 'request_id': 'req-613db2b5-7809-48b9-aea6-e324ecd9d4d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.149835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] The token cache is being invalidate because project c4fb003407e74981b146a4fcf6699e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:27.150085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.150826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.152556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1201/2385] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:26 2022] DELETE /identity/v3/projects/c4fb003407e74981b146a4fcf6699e97 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:27.156265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.157709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:27.175129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377d570-bf91-4b54-a8d5-03d669281994 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.247265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.248188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.248479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.248759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] PATH_INFO: `/v3/users/a60017be364144d2b30447bc151687ab` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.250656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a60017be364144d2b30447bc151687ab)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.253490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.293306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.296016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:27.301320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:27.311337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613db2b5-7809-48b9-aea6-e324ecd9d4d3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.319544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.320298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.320580 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.320856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] PATH_INFO: `/v3/projects/03617fc3725343318871f16a3810b948` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.322079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=03617fc3725343318871f16a3810b948)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.324207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.338048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a60017be364144d2b30447bc151687ab'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.338048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a60017be364144d2b30447bc151687ab'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.340636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a60017be364144d2b30447bc151687ab'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.352911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a60017be364144d2b30447bc151687ab'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.353742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:27.386924 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-26071457-d5cb-4047-8bf5-17f6e47eafe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a60017be364144d2b30447bc151687ab'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.391876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03617fc3725343318871f16a3810b948', 'request_id': 'req-9e717d7d-fb32-4db4-a873-08ff618a23bd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.398498 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03617fc3725343318871f16a3810b948', 'request_id': 'req-9e717d7d-fb32-4db4-a873-08ff618a23bd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.405322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03617fc3725343318871f16a3810b948', 'request_id': 'req-9e717d7d-fb32-4db4-a873-08ff618a23bd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.405723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1185/2386] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:27 2022] DELETE /identity/v3/users/a60017be364144d2b30447bc151687ab => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:27.420256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] The token cache is being invalidate because project 03617fc3725343318871f16a3810b948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:27.420525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.421206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-9e717d7d-fb32-4db4-a873-08ff618a23bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.422962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1202/2387] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:27 2022] DELETE /identity/v3/projects/03617fc3725343318871f16a3810b948 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:27.427987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8c15-9999-4db5-854b-582b729cd90b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.428282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8c15-9999-4db5-854b-582b729cd90b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.428566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f8c15-9999-4db5-854b-582b729cd90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.449232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-490f8c15-9999-4db5-854b-582b729cd90b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:27.450659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-490f8c15-9999-4db5-854b-582b729cd90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:27.529141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1186/2388] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:27.537539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433512a-d941-401f-a1c7-3091f354083c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.537910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433512a-d941-401f-a1c7-3091f354083c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.538265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433512a-d941-401f-a1c7-3091f354083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.558536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-5433512a-d941-401f-a1c7-3091f354083c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:27.559789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5433512a-d941-401f-a1c7-3091f354083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:27.567968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1203/2389] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:27.572205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8c15-9999-4db5-854b-582b729cd90b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.583135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f8c15-9999-4db5-854b-582b729cd90b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.588375 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.589053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.589337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.589614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.590370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:27.590678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.592646 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.606096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1187/2390] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:14:27.610593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433512a-d941-401f-a1c7-3091f354083c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.620458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433512a-d941-401f-a1c7-3091f354083c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.631728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.632485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.632842 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.633221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.634290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.637546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.689366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.689648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1204/2391] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:27 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:14:27.701570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db061490-3c8b-443a-b360-95f9f359ccac admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.778884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.779622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.779932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.780254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.780965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.784154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.815867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1188/2392] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:27 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:27.817275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.832103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea635d-8173-4459-b230-ce29022b03b2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.833970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.835752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:27.837542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.838376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.838821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.838974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.839708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.841338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.851235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7d541-ea79-4a2a-92b3-eae1747b20bd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.854916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1205/2393] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:27.857748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.858963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.859925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.860216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.860497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] PATH_INFO: `/v3/projects/3475f437dc4d4969a950a8d1d47c165a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.861739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3475f437dc4d4969a950a8d1d47c165a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.863975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.868525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49554bb9-2f8e-49a0-a93f-3adcbfd78421 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.875569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.876321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.876615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.876901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.878289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:27.880614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:27.887805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:27.895574 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1206/2394] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:14:27.897194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.909477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c73d9e-4b41-4976-b9bb-0ee469386190 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:27.920206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3475f437dc4d4969a950a8d1d47c165a', 'request_id': 'req-42fde02f-c99d-437c-b501-c4dcdaa9c419'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.928037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3475f437dc4d4969a950a8d1d47c165a', 'request_id': 'req-42fde02f-c99d-437c-b501-c4dcdaa9c419'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.934099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3475f437dc4d4969a950a8d1d47c165a', 'request_id': 'req-42fde02f-c99d-437c-b501-c4dcdaa9c419'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.946443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] The token cache is being invalidate because project 3475f437dc4d4969a950a8d1d47c165a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:27.946731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.947424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:27.950146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1189/2395] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:27 2022] DELETE /identity/v3/projects/3475f437dc4d4969a950a8d1d47c165a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:27.954109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:27.955553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:27.975944 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fecb46-28e3-4c3a-a6d1-04ca20595f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:27.977252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecb46-28e3-4c3a-a6d1-04ca20595f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:27.977780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecb46-28e3-4c3a-a6d1-04ca20595f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:27.978338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fecb46-28e3-4c3a-a6d1-04ca20595f9a admin admin] PATH_INFO: `/v3/projects/937298d031bc4e97a36d97478403481b/users/ecd05a35f90b4ef2ab7f4bc02bccc5ad/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:27.997689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecb46-28e3-4c3a-a6d1-04ca20595f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=937298d031bc4e97a36d97478403481b, user_id=ecd05a35f90b4ef2ab7f4bc02bccc5ad, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:28.000845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fecb46-28e3-4c3a-a6d1-04ca20595f9a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:28.017991 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1207/2396] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:27 2022] PUT /identity/v3/projects/937298d031bc4e97a36d97478403481b/users/ecd05a35f90b4ef2ab7f4bc02bccc5ad/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:28.030653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:28.030974 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:28.031253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:28.055425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde02f-c99d-437c-b501-c4dcdaa9c419 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:28.060316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] MFA Rules not processed for user `ecd05a35f90b4ef2ab7f4bc02bccc5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:28.061563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:28.091285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:28.118538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:28.119460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:28.119748 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:28.120098 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] PATH_INFO: `/v3/users/5c24b3dfa3784527af089dd3275c50bc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:28.121460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c24b3dfa3784527af089dd3275c50bc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:28.123464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:28.135345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1208/2397] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:28.147196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:28.148593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:28.176800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c24b3dfa3784527af089dd3275c50bc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.177530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c24b3dfa3784527af089dd3275c50bc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.178441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c24b3dfa3784527af089dd3275c50bc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.184841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:28.187151 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c24b3dfa3784527af089dd3275c50bc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.203542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c24b3dfa3784527af089dd3275c50bc'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.210950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a37c1-095e-44ca-84d2-0d207a95b2f0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:28.215599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9dea1-c396-4c5a-a9f4-0a4b69da439c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8376ffaa09e2496a80fa60c979769d8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:28.216401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9dea1-c396-4c5a-a9f4-0a4b69da439c service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:28.219625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1190/2398] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:14:27 2022] DELETE /identity/v3/users/5c24b3dfa3784527af089dd3275c50bc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:14:28.219742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9dea1-c396-4c5a-a9f4-0a4b69da439c service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:28.219742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9dea1-c396-4c5a-a9f4-0a4b69da439c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:28.219742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5dd9dea1-c396-4c5a-a9f4-0a4b69da439c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:28.231398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9dea1-c396-4c5a-a9f4-0a4b69da439c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:28.232948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9dea1-c396-4c5a-a9f4-0a4b69da439c service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:28.243386 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1209/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:14:28.653176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:28.654750 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:28.756465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c1899-c79c-45b5-a9da-04b71c99d829 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:28.768529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:28.770431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:28.770976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:28.771442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] PATH_INFO: `/v3/projects/10ad144877ae44d599be4e8bcfd8c5ca` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:28.772867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ad144877ae44d599be4e8bcfd8c5ca)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:28.776925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:28.838223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ad144877ae44d599be4e8bcfd8c5ca', 'request_id': 'req-5d54b5cb-604a-4874-9c91-f6b90475eca4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.847716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ad144877ae44d599be4e8bcfd8c5ca', 'request_id': 'req-5d54b5cb-604a-4874-9c91-f6b90475eca4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.854403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ad144877ae44d599be4e8bcfd8c5ca', 'request_id': 'req-5d54b5cb-604a-4874-9c91-f6b90475eca4'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.865905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] The token cache is being invalidate because project 10ad144877ae44d599be4e8bcfd8c5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:14:28.866197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.866896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-5d54b5cb-604a-4874-9c91-f6b90475eca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:14:28.868446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1191/2400] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:14:28 2022] DELETE /identity/v3/projects/10ad144877ae44d599be4e8bcfd8c5ca => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:28.874385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f749e-6358-42e9-a22d-5ead0857a2c0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:28.874957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f749e-6358-42e9-a22d-5ead0857a2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:28.875054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f749e-6358-42e9-a22d-5ead0857a2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:28.895597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9c5f749e-6358-42e9-a22d-5ead0857a2c0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:28.896840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9c5f749e-6358-42e9-a22d-5ead0857a2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:28.973400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1210/2401] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:28.981858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbf07-d18f-495a-8c3e-2ff3341c79f4 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:28.982345 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbf07-d18f-495a-8c3e-2ff3341c79f4 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:28.982567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbf07-d18f-495a-8c3e-2ff3341c79f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.014662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f86cbf07-d18f-495a-8c3e-2ff3341c79f4 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:29.016187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f86cbf07-d18f-495a-8c3e-2ff3341c79f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:29.025369 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1192/2402] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:14:29.029373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f749e-6358-42e9-a22d-5ead0857a2c0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:29.039737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f749e-6358-42e9-a22d-5ead0857a2c0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:29.044326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:29.044978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:29.045262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:29.045534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.046264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:14:29.046569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:29.048198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:29.060148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1211/2403] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:14:29.064341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cbf07-d18f-495a-8c3e-2ff3341c79f4 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:29.073553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cbf07-d18f-495a-8c3e-2ff3341c79f4 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:29.078344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:29.079030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:29.079318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:29.079597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.080291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:29.082752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:29.110690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1193/2404] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:14:29 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:14:29.114708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:29.124962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8d250-8f6c-4b20-8398-82f224e94b2a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:29.221568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:29.222259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:29.222547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:29.222827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.223549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:29.225545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:29.233811 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:29.251888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1212/2405] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:14:29 2022] POST /identity/v3/users => generated 285 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:14:29.256394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:29.269066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3fc5-3ae8-43b5-b2f7-e5e444eb0aab admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:29.274485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:29.275268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:29.275597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:29.279789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.283964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:29.286915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:29.308987 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1194/2406] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:14:29.313445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:29.327458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ef5ff-d361-430a-9e45-1143d3f0e146 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:29.332945 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615ec41-5342-41e6-8cf9-a634572d0c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:29.333626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ec41-5342-41e6-8cf9-a634572d0c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:29.333910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ec41-5342-41e6-8cf9-a634572d0c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:29.334187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615ec41-5342-41e6-8cf9-a634572d0c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.334951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ec41-5342-41e6-8cf9-a634572d0c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:29.337772 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615ec41-5342-41e6-8cf9-a634572d0c15 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:29.354298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1213/2407] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:14:29.355606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:29.366801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b7f58-8e1e-4b59-a12f-7c5ea54b4b4f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:29.372906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405e130-6ac1-4798-851c-e6b4b5394640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:29.373474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e130-6ac1-4798-851c-e6b4b5394640 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:29.373763 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e130-6ac1-4798-851c-e6b4b5394640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:29.374077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e130-6ac1-4798-851c-e6b4b5394640 admin admin] PATH_INFO: `/v3/projects/35fe946d47584f7a90a326a6c2346688/users/dee1baad8f5e411eb070543efbbd52e0/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.397243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405e130-6ac1-4798-851c-e6b4b5394640 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fe946d47584f7a90a326a6c2346688, user_id=dee1baad8f5e411eb070543efbbd52e0, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:29.400056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405e130-6ac1-4798-851c-e6b4b5394640 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:29.408783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:29.417129 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1195/2408] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:14:29 2022] PUT /identity/v3/projects/35fe946d47584f7a90a326a6c2346688/users/dee1baad8f5e411eb070543efbbd52e0/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:14:29.428241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:29.428531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:29.428805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:29.456929 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] MFA Rules not processed for user `dee1baad8f5e411eb070543efbbd52e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:29.458126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:29.526364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1214/2409] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:31.679505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:31.680074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:31.680074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:31.698450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] MFA Rules not processed for user `5f25f2bd027e4b0089063e0581a1f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:14:31.699676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:31.766166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1196/2410] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:14:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:14:39.523194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:41.130549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:14:41.132053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:14:41.220748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233437-676f-48a2-89e0-1fdfb6eefc3c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:14:41.224345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fb4e8-5014-4cac-a89f-4b060dc7b8e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8376ffaa09e2496a80fa60c979769d8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:14:41.224992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb4e8-5014-4cac-a89f-4b060dc7b8e9 service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:14:41.225278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb4e8-5014-4cac-a89f-4b060dc7b8e9 service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:14:41.225633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fb4e8-5014-4cac-a89f-4b060dc7b8e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:14:41.250449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fb4e8-5014-4cac-a89f-4b060dc7b8e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:14:41.252007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fb4e8-5014-4cac-a89f-4b060dc7b8e9 service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:14:41.262457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1215/2411] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:14:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:14:41.759366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=26 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:14:51.257379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=45 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:00.319577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:00.321005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:00.458574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eede54-6b25-43f1-8ba3-6dce98818183 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:00.463484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:00.464357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:00.464647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:00.464933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] PATH_INFO: `/v3/users/66ccb4394da24a15a9b791c1c5e893f0` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:00.466133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ccb4394da24a15a9b791c1c5e893f0)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:00.468739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:00.524279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ccb4394da24a15a9b791c1c5e893f0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:00.527558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ccb4394da24a15a9b791c1c5e893f0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:00.527558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ccb4394da24a15a9b791c1c5e893f0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:00.533628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ccb4394da24a15a9b791c1c5e893f0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:00.545711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ccb4394da24a15a9b791c1c5e893f0'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:00.559857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1197/2412] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:15:00 2022] DELETE /identity/v3/users/66ccb4394da24a15a9b791c1c5e893f0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:00.564357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:00.564876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:00.565000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:00.595586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:00.596791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:00.656908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1216/2413] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:00.666546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:00.668002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:00.691612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:00.753640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ee375-4c77-469b-afbe-f29525adf6d3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:00.761813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b0395f-7744-4580-8bb4-79082b79dd40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:00.762456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0395f-7744-4580-8bb4-79082b79dd40 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:00.762827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0395f-7744-4580-8bb4-79082b79dd40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:00.763171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b0395f-7744-4580-8bb4-79082b79dd40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:00.773937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0395f-7744-4580-8bb4-79082b79dd40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:00.775431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b0395f-7744-4580-8bb4-79082b79dd40 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:00.785661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1198/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:01.078406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.079872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:01.092055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad22b0-80c7-4b82-ab2e-b84cbcf60b09 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.097221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.098086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.098371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.098650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] PATH_INFO: `/v3/projects/442aea638c6d4c168f801aa5b1fc8940` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.099920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=442aea638c6d4c168f801aa5b1fc8940)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.101984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.156237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442aea638c6d4c168f801aa5b1fc8940', 'request_id': 'req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:01.161861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442aea638c6d4c168f801aa5b1fc8940', 'request_id': 'req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:01.168410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442aea638c6d4c168f801aa5b1fc8940', 'request_id': 'req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:01.184897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] The token cache is being invalidate because project 442aea638c6d4c168f801aa5b1fc8940 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:15:01.185233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:01.185954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0f8b3f7b-fe64-4944-90e0-823ebaf557bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:01.188864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1217/2415] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:15:01 2022] DELETE /identity/v3/projects/442aea638c6d4c168f801aa5b1fc8940 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:01.193835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f83d9-96c0-41dc-bbdf-b6a23d2d3b84 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.194066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f83d9-96c0-41dc-bbdf-b6a23d2d3b84 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.194607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f83d9-96c0-41dc-bbdf-b6a23d2d3b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.255649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0f3f83d9-96c0-41dc-bbdf-b6a23d2d3b84 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:01.256929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0f3f83d9-96c0-41dc-bbdf-b6a23d2d3b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:01.322700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1199/2416] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:01.331768 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4e288-a89d-4e01-ae8d-c507b9d84eaf None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.332099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4e288-a89d-4e01-ae8d-c507b9d84eaf None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.332382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4e288-a89d-4e01-ae8d-c507b9d84eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.355148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f8e4e288-a89d-4e01-ae8d-c507b9d84eaf None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:01.356572 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f8e4e288-a89d-4e01-ae8d-c507b9d84eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:01.366090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1218/2417] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:01.370237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f83d9-96c0-41dc-bbdf-b6a23d2d3b84 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.380762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f83d9-96c0-41dc-bbdf-b6a23d2d3b84 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.385881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.386544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.386865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.387160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.387898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:15:01.388327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.390073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.402880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1200/2418] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:15:01.407289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4e288-a89d-4e01-ae8d-c507b9d84eaf None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.417321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4e288-a89d-4e01-ae8d-c507b9d84eaf None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.424022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.424706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.424995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.425292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.425973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.428082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.454285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1219/2419] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:15:01 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:15:01.458318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.469210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc721f91-1805-4bd2-aedc-11f3442b1a84 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.547949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.548629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.548915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.549195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.549896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.551867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.561205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:01.574143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1201/2420] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:15:01 2022] POST /identity/v3/users => generated 282 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:15:01.578213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.588603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52354f-1d74-488d-af61-107552501716 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.594109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.594764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.595085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.595635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.596412 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.598197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.612593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1220/2421] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:01.615421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.629459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13491d0a-b218-492f-b7fa-f2d4eca2c173 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.635190 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3ab40-1ffd-4086-8255-1ee2a115fcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.636175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ab40-1ffd-4086-8255-1ee2a115fcbd admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.636600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ab40-1ffd-4086-8255-1ee2a115fcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.637046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3ab40-1ffd-4086-8255-1ee2a115fcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.638112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3ab40-1ffd-4086-8255-1ee2a115fcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.640759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3ab40-1ffd-4086-8255-1ee2a115fcbd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.657640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1202/2422] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:01.659722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.674316 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0049e845-45fa-404c-9e9f-977f622b7b88 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.682058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.683144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.683419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.683693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] PATH_INFO: `/v3/projects/5463c66da68a48c9a3c540a184e36ab0/users/c44db6f008504d8a900b7bf897baff0f/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.704950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5463c66da68a48c9a3c540a184e36ab0, user_id=c44db6f008504d8a900b7bf897baff0f, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.707670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.724759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1221/2423] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:01 2022] PUT /identity/v3/projects/5463c66da68a48c9a3c540a184e36ab0/users/c44db6f008504d8a900b7bf897baff0f/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:01.736475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9be49-2ee9-4876-9642-c34465f6c275 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.736768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9be49-2ee9-4876-9642-c34465f6c275 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.737045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9be49-2ee9-4876-9642-c34465f6c275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.779248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ecd9be49-2ee9-4876-9642-c34465f6c275 None None] MFA Rules not processed for user `c44db6f008504d8a900b7bf897baff0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:01.781218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ecd9be49-2ee9-4876-9642-c34465f6c275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:01.870716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1203/2424] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:01 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:01.882338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:01.884036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:01.898726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:01.945308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ee64a-a283-4e10-b416-acd36ff0eb59 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:01.949210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:01.949861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:01.950146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:01.950425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:01.961005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:01.962373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:01.979782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1222/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:01 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:04.170631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10f86f-9d21-4836-8e91-f9db410fd8fc None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:04.171229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10f86f-9d21-4836-8e91-f9db410fd8fc None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:04.171332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10f86f-9d21-4836-8e91-f9db410fd8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:04.202159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-dc10f86f-9d21-4836-8e91-f9db410fd8fc None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:04.203912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-dc10f86f-9d21-4836-8e91-f9db410fd8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:04.272674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1204/2426] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:15:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:04.320983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:04.322436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:04.406485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026738c-d9fe-4ada-abf0-2abe0fe2e2e4 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:04.412285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74454e-60a3-4b75-b47d-a44567ee6742 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:04.413000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74454e-60a3-4b75-b47d-a44567ee6742 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:04.413375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74454e-60a3-4b75-b47d-a44567ee6742 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:04.413716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74454e-60a3-4b75-b47d-a44567ee6742 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:04.424129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74454e-60a3-4b75-b47d-a44567ee6742 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:04.425869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74454e-60a3-4b75-b47d-a44567ee6742 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:04.435981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1223/2427] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:15:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:15:13.465862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:13.466442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:13.466442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:13.486513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] MFA Rules not processed for user `13a00d0c317a4e69aa84b3851d5f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:13.487826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:13.556765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1205/2428] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:14.432650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=52 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:23.548136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=1,keystone:SELECT=96 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:24.521741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:24.522435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:24.523029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:24.543445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:24.544804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:24.655805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1224/2429] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:24.677657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:24.679471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:24.845875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002be4de-c19d-4536-9ded-3389f0854892 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:24.856810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb7b0a-c654-41ae-95c8-8a388084c9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:24.857620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb7b0a-c654-41ae-95c8-8a388084c9b5 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:24.858485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb7b0a-c654-41ae-95c8-8a388084c9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:24.858766 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb7b0a-c654-41ae-95c8-8a388084c9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:24.879799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb7b0a-c654-41ae-95c8-8a388084c9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:24.885237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb7b0a-c654-41ae-95c8-8a388084c9b5 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:24.909945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1206/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:28.258265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:28.259903 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.271553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0ccf9-d834-4b3b-a2d2-42f92d316a01 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:28.276334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:28.277210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.277493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.277769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] PATH_INFO: `/v3/users/dee1baad8f5e411eb070543efbbd52e0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.278986 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dee1baad8f5e411eb070543efbbd52e0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:28.280917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:28.332044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dee1baad8f5e411eb070543efbbd52e0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.342245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dee1baad8f5e411eb070543efbbd52e0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.342879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dee1baad8f5e411eb070543efbbd52e0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.355000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dee1baad8f5e411eb070543efbbd52e0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.355665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dee1baad8f5e411eb070543efbbd52e0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.368905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1225/2431] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:15:28 2022] DELETE /identity/v3/users/dee1baad8f5e411eb070543efbbd52e0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:28.376367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.376917 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:28.377017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.377017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.378026 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.395470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:28.396674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.451795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb1ce2-c5e3-48a9-8c52-0896add1125b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:28.456535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:28.457526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.457813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.458090 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] PATH_INFO: `/v3/users/ecd05a35f90b4ef2ab7f4bc02bccc5ad` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.459331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecd05a35f90b4ef2ab7f4bc02bccc5ad)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:28.459976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1207/2432] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:28.461283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:28.470231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:28.471672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.477315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:28.536796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecd05a35f90b4ef2ab7f4bc02bccc5ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.551259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecd05a35f90b4ef2ab7f4bc02bccc5ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.551945 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecd05a35f90b4ef2ab7f4bc02bccc5ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.552085 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9372af5-7ee5-448c-b54f-95ad9c6e37c5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:28.556754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:28.557504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.557777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.558056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.568078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:28.568235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecd05a35f90b4ef2ab7f4bc02bccc5ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.568813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-265b56ed-8cc7-44d7-888c-ee5019752b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecd05a35f90b4ef2ab7f4bc02bccc5ad'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.569561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:28.582384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1208/2434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:28.582579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1226/2434] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:15:28 2022] DELETE /identity/v3/users/ecd05a35f90b4ef2ab7f4bc02bccc5ad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:15:28.586513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047917-704a-45d9-b5af-7d158086bd21 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.586813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047917-704a-45d9-b5af-7d158086bd21 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.587124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b047917-704a-45d9-b5af-7d158086bd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.607099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9b047917-704a-45d9-b5af-7d158086bd21 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:28.608916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9b047917-704a-45d9-b5af-7d158086bd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.710382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1227/2435] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:28.731406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:28.736012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.750093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fe3d3-198c-45aa-883a-e9aab486f7cd service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:28.758490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:28.800726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3663063-d63e-4985-998e-7f5601231825 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.801098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3663063-d63e-4985-998e-7f5601231825 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.801449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3663063-d63e-4985-998e-7f5601231825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.813075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:28.813614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.813906 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.814189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.824435 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:28.825896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:28.837313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1209/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:28.863248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c3663063-d63e-4985-998e-7f5601231825 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:28.864473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c3663063-d63e-4985-998e-7f5601231825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.885948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:28.890963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.909175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05b9d-93cd-4259-84e8-f73c5b733dcf service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:28.916982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:28.917902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:28.918373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:28.918647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] PATH_INFO: `/v3/projects/35fe946d47584f7a90a326a6c2346688` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:28.920018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fe946d47584f7a90a326a6c2346688)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:28.922044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:28.977560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1228/2437] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 20:15:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:28.986598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fe946d47584f7a90a326a6c2346688', 'request_id': 'req-d032b764-aee9-4998-93be-168605e8e4d1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:28.991788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3663063-d63e-4985-998e-7f5601231825 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:28.993810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c3663063-d63e-4985-998e-7f5601231825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:28.999021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fe946d47584f7a90a326a6c2346688', 'request_id': 'req-d032b764-aee9-4998-93be-168605e8e4d1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.000802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:29.013505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fe946d47584f7a90a326a6c2346688', 'request_id': 'req-d032b764-aee9-4998-93be-168605e8e4d1'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.035242 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] The token cache is being invalidate because project 35fe946d47584f7a90a326a6c2346688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:15:29.035623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.036386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-d032b764-aee9-4998-93be-168605e8e4d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.041552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1210/2438] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:15:28 2022] DELETE /identity/v3/projects/35fe946d47584f7a90a326a6c2346688 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:15:29.044142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c979b-6bf5-42e4-86b5-cafc7da19410 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.051024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c979b-6bf5-42e4-86b5-cafc7da19410 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.051265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c979b-6bf5-42e4-86b5-cafc7da19410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.078627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-680c979b-6bf5-42e4-86b5-cafc7da19410 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:29.081902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-680c979b-6bf5-42e4-86b5-cafc7da19410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.119423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3663063-d63e-4985-998e-7f5601231825 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.159209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1211/2439] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:29.167080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.167497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.167912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.191214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:29.192527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.206948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1212/2440] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:29.208092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.210073 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.217620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.218518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.219023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.219468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.222549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.241443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6304cba-702b-4b69-9534-6da6a0fea0e3 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.253454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.254722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.255106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.255459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] PATH_INFO: `/v3/projects/937298d031bc4e97a36d97478403481b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.256778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=937298d031bc4e97a36d97478403481b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.259209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.287798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:29.300372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.301996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.314163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1229/2441] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:15:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 20:15:29.315518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.319546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '937298d031bc4e97a36d97478403481b', 'request_id': 'req-94e02986-1d13-485a-a116-db7d6b269d92'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.328856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe4d4e-4a64-4f97-84a0-cffd5fc98546 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.330527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '937298d031bc4e97a36d97478403481b', 'request_id': 'req-94e02986-1d13-485a-a116-db7d6b269d92'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.338643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '937298d031bc4e97a36d97478403481b', 'request_id': 'req-94e02986-1d13-485a-a116-db7d6b269d92'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.362882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] The token cache is being invalidate because project 937298d031bc4e97a36d97478403481b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:15:29.362882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.363525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-94e02986-1d13-485a-a116-db7d6b269d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:29.365940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1213/2442] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:15:29 2022] DELETE /identity/v3/projects/937298d031bc4e97a36d97478403481b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:29.367834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:29.371773 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ede86-d1db-4100-a83b-731b8986e2ab None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.371999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ede86-d1db-4100-a83b-731b8986e2ab None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.372281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ede86-d1db-4100-a83b-731b8986e2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.401586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-399ede86-d1db-4100-a83b-731b8986e2ab None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:29.403279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-399ede86-d1db-4100-a83b-731b8986e2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.462223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.462952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.463241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.463525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.464268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:15:29.464585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.466266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.494331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1230/2443] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:15:29.500761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.506765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.528874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190f69b-2b0c-4f26-a184-a5077f3d5edc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.536885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.538601 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.539805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.541211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.542244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.545513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.553115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1214/2444] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:29.554730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e43cd-e97e-4f61-9c69-9f8e1f627b5a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.555096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e43cd-e97e-4f61-9c69-9f8e1f627b5a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.555378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e43cd-e97e-4f61-9c69-9f8e1f627b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.585367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-600e43cd-e97e-4f61-9c69-9f8e1f627b5a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:29.585515 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1231/2445] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:29.586801 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-600e43cd-e97e-4f61-9c69-9f8e1f627b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.590008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.669459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1215/2446] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:29.674637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb74e9-3a35-47eb-adac-b63ff325fdb5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.674996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb74e9-3a35-47eb-adac-b63ff325fdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.675366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb74e9-3a35-47eb-adac-b63ff325fdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.699858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a9bb74e9-3a35-47eb-adac-b63ff325fdb5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:29.701099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a9bb74e9-3a35-47eb-adac-b63ff325fdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.722260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f4357-8922-493b-a45d-f1a350edfb39 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.728461 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1216/2447] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:29.730356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb74e9-3a35-47eb-adac-b63ff325fdb5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.734398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.735229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.737133 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.737506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.738637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.742095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.750271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb74e9-3a35-47eb-adac-b63ff325fdb5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.757568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.758482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.758893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.759351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.762295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:15:29.762295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.762737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.778616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1232/2448] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:29.784651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1217/2449] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:15:29.784852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.785875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.787792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:29.797681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66a955-5180-400c-a3d5-c31ef46fec8c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.804298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.805727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.806496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.806859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.807792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.810023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.827473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1233/2450] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:29.827473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.838738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51894304-9e80-49ec-bb05-347b4458732e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:29.845069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:29.845922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:29.846367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:29.846695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:29.847806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:29.848693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:29.851084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:29.908060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1234/2451] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:15:29 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:29.908060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:29.925971 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451499d8-3057-4530-ad67-22120357bb81 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.013752 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.014178 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.014993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.014993 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.039276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:30.046639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c89b-0ae7-40f4-929f-90000dbd86f1 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.058625 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.059857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.060319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.060932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.062129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.064303 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.078807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1235/2452] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:30.080352 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:30.097182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beeb704-201b-4198-b088-60cd6161959a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.104098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.104890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.106023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.106422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.108344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.111561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.132651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.137211 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.141233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1236/2453] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:15:30 2022] POST /identity/v3/users => generated 286 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:30.141233 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:30.149775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1218/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:30.150756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:30.161725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797503d5-94e9-42ac-a026-0e5300f50cd6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.164624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43dd37-cef5-4e03-a0c1-10f712ef45f0 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.175603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be966-e390-47f4-a6d1-dac37a8ecf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.177075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be966-e390-47f4-a6d1-dac37a8ecf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.177899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.178889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be966-e390-47f4-a6d1-dac37a8ecf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.178889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be966-e390-47f4-a6d1-dac37a8ecf7e admin admin] PATH_INFO: `/v3/projects/969e353aca654e2ea45582104df1f419/users/9f56d4a83d8d47f2abe9b0aa77f178a5/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.179753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.180324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.181465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.182303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.184488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.202783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1219/2455] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:30.207422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:30.213520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be966-e390-47f4-a6d1-dac37a8ecf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=969e353aca654e2ea45582104df1f419, user_id=9f56d4a83d8d47f2abe9b0aa77f178a5, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.216709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be966-e390-47f4-a6d1-dac37a8ecf7e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.222364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d738d-b3a1-47e0-9ede-62d8a8068294 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.233857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.236131 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.236490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.236836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.238571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.241116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1237/2456] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:30 2022] PUT /identity/v3/projects/969e353aca654e2ea45582104df1f419/users/9f56d4a83d8d47f2abe9b0aa77f178a5/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:30.242901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.245961 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.247232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.249342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.278626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1220/2457] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:15:30.287080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:30.301008 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:30.301844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cb883-3b0a-4767-abe4-1984ed0aa963 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.302540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:30.357334 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:30.385972 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e47b57-a9a8-45b3-8e62-1328d9cb315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.387023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47b57-a9a8-45b3-8e62-1328d9cb315c admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.387197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47b57-a9a8-45b3-8e62-1328d9cb315c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.387479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e47b57-a9a8-45b3-8e62-1328d9cb315c admin admin] PATH_INFO: `/v3/projects/2959aa6f558f4e9b93b4e9aed3aa5f1a/users/37020900c19b4887b2b0628af754d388/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.405388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e47b57-a9a8-45b3-8e62-1328d9cb315c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2959aa6f558f4e9b93b4e9aed3aa5f1a, user_id=37020900c19b4887b2b0628af754d388, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.408193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e47b57-a9a8-45b3-8e62-1328d9cb315c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.418554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1238/2458] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:30.427984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1221/2459] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:30 2022] PUT /identity/v3/projects/2959aa6f558f4e9b93b4e9aed3aa5f1a/users/37020900c19b4887b2b0628af754d388/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:30.432658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:30.433006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6ffd-018d-4d44-9eec-874f1755382a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.433301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6ffd-018d-4d44-9eec-874f1755382a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.433580 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6ffd-018d-4d44-9eec-874f1755382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.434738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:30.454102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-10da6ffd-018d-4d44-9eec-874f1755382a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:30.455017 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-10da6ffd-018d-4d44-9eec-874f1755382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:30.501968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8211fb-0b46-4406-a9a1-f8b2782a884d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.533513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1222/2460] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:30.543473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6ffd-018d-4d44-9eec-874f1755382a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:30.579664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.580241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.581021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.581311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.591395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.593423 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.604338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6ffd-018d-4d44-9eec-874f1755382a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:30.605240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1239/2461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:15:30.608432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:30.609422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:30.609422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:30.609606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:30.619799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:30.625579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:30.637851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1223/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:15:32.580955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:32.582930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:32.600062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21650ec8-74dc-41b3-8fac-2f157bde92f7 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:32.605541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:32.607558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:32.608762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:32.610281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] PATH_INFO: `/v3/users/5f25f2bd027e4b0089063e0581a1f9af` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:32.612471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f25f2bd027e4b0089063e0581a1f9af)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:32.617304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:32.661770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:32.754384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f25f2bd027e4b0089063e0581a1f9af'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:32.768899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f25f2bd027e4b0089063e0581a1f9af'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:32.769759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f25f2bd027e4b0089063e0581a1f9af'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:32.788009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f25f2bd027e4b0089063e0581a1f9af'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:32.788953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-dbca352b-4fd8-448a-8919-78b05b7489a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f25f2bd027e4b0089063e0581a1f9af'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:32.808818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1240/2463] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:15:32 2022] DELETE /identity/v3/users/5f25f2bd027e4b0089063e0581a1f9af => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:33.116830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:33.138659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4295f28-94f7-4051-be4d-5b931551093a service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:33.268493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:33.270165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:33.270915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:33.271350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] PATH_INFO: `/v3/projects/de1d8d078f764029ae85934daf55b6a2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:33.273425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1d8d078f764029ae85934daf55b6a2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:33.277272 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:33.301168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:33.412419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1d8d078f764029ae85934daf55b6a2', 'request_id': 'req-aa550659-fa86-48d1-a1ae-632376ef8207'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:33.433698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1d8d078f764029ae85934daf55b6a2', 'request_id': 'req-aa550659-fa86-48d1-a1ae-632376ef8207'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:33.443960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1d8d078f764029ae85934daf55b6a2', 'request_id': 'req-aa550659-fa86-48d1-a1ae-632376ef8207'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:33.464376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] The token cache is being invalidate because project de1d8d078f764029ae85934daf55b6a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:15:33.464879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:33.465888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa550659-fa86-48d1-a1ae-632376ef8207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:33.468286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1224/2464] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:15:33 2022] DELETE /identity/v3/projects/de1d8d078f764029ae85934daf55b6a2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:33.474546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684607-7f48-48ef-9afd-489b463fb717 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:33.475167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684607-7f48-48ef-9afd-489b463fb717 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:33.475962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684607-7f48-48ef-9afd-489b463fb717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:33.504950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b9684607-7f48-48ef-9afd-489b463fb717 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:33.507159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b9684607-7f48-48ef-9afd-489b463fb717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:33.691191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1241/2465] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:33.698473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4455781-2305-4806-b51f-035ce524f763 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:33.699255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4455781-2305-4806-b51f-035ce524f763 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:33.699782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4455781-2305-4806-b51f-035ce524f763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:33.732943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-f4455781-2305-4806-b51f-035ce524f763 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:33.734735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f4455781-2305-4806-b51f-035ce524f763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:33.751935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1225/2466] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:33.755762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684607-7f48-48ef-9afd-489b463fb717 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:33.771805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684607-7f48-48ef-9afd-489b463fb717 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:33.780531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:33.782060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:33.782562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:33.783219 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:33.785894 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:15:33.788821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:33.790953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:33.812152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1242/2467] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:15:33.815984 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4455781-2305-4806-b51f-035ce524f763 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:33.835891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4455781-2305-4806-b51f-035ce524f763 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:33.844495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:33.845916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:33.846440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:33.847531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:33.848768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:33.851357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:33.997757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1226/2468] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:15:33 2022] POST /identity/v3/projects => generated 373 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:15:34.002264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:34.016649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff26ee-aa07-448a-911c-4f3cb229f12a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:34.147818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:34.148409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:34.148696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:34.148977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:34.149697 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:34.151698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:34.178664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:34.190954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1243/2469] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:15:34 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:15:34.191149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:34.202451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedae2bc-fd9e-4010-b924-2a63d1c62ad6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:34.216851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:34.220610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:34.221112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:34.221621 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:34.222946 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:34.226767 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:34.246552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:34.254322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1227/2470] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:15:34.265001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb49320d-51cf-40ee-9ef5-41b590eef891 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:34.272624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c0e89-b54e-4c4d-bb98-7340e5fc02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:34.273511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0e89-b54e-4c4d-bb98-7340e5fc02f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:34.274390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0e89-b54e-4c4d-bb98-7340e5fc02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:34.274677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c0e89-b54e-4c4d-bb98-7340e5fc02f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:34.275506 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c0e89-b54e-4c4d-bb98-7340e5fc02f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:34.278049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c0e89-b54e-4c4d-bb98-7340e5fc02f9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:34.296934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:34.297500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1244/2471] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:34.317716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080db07-2293-4459-bef3-7a69090ec6eb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:34.327373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:34.331598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:34.331598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:34.331598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] PATH_INFO: `/v3/projects/d7b95f958f4b442e861837ead5101cfc/users/4cb7126759af459d949a6a97b19d1555/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:34.348476 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b95f958f4b442e861837ead5101cfc, user_id=4cb7126759af459d949a6a97b19d1555, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:34.351472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:34.378540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1228/2472] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:34 2022] PUT /identity/v3/projects/d7b95f958f4b442e861837ead5101cfc/users/4cb7126759af459d949a6a97b19d1555/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:34.380520 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e44f1-b7ac-4000-8300-b901e07c58ed None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:34.380816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e44f1-b7ac-4000-8300-b901e07c58ed None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:34.381104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e44f1-b7ac-4000-8300-b901e07c58ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:34.421377 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-795e44f1-b7ac-4000-8300-b901e07c58ed None None] MFA Rules not processed for user `4cb7126759af459d949a6a97b19d1555`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:34.423375 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-795e44f1-b7ac-4000-8300-b901e07c58ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:34.534206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1245/2473] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:34.548096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:34.550049 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:34.723960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a6322-b4d4-40ff-bdc8-c4a447f4821b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:34.730959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82610193-44c8-4d42-b454-ab4ede689927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:34.732054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82610193-44c8-4d42-b454-ab4ede689927 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:34.732821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82610193-44c8-4d42-b454-ab4ede689927 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:34.733553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82610193-44c8-4d42-b454-ab4ede689927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:34.746353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82610193-44c8-4d42-b454-ab4ede689927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:34.750063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82610193-44c8-4d42-b454-ab4ede689927 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:34.773771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1229/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:34.797519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e44f1-b7ac-4000-8300-b901e07c58ed None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:34.928012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e44f1-b7ac-4000-8300-b901e07c58ed None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:34.969684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:34.972984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:34.973408 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:34.973845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] PATH_INFO: `/v3/users/4cb7126759af459d949a6a97b19d1555` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:34.976819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb7126759af459d949a6a97b19d1555)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:34.991441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:35.193240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb7126759af459d949a6a97b19d1555'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:35.226346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb7126759af459d949a6a97b19d1555'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:35.249716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb7126759af459d949a6a97b19d1555'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:35.295776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb7126759af459d949a6a97b19d1555'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:35.297111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb7126759af459d949a6a97b19d1555'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:35.308306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:35.321295 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1246/2475] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:15:34 2022] DELETE /identity/v3/users/4cb7126759af459d949a6a97b19d1555 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:35.323633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:35.324125 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:35.324204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:35.354592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:35.357450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:35.391593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:35.522699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1230/2476] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:35.565875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:35.568135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:35.704503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c0729-2523-4fec-bd10-70a5746d3647 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:35.712832 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8618175-5098-4e22-bcd7-e1ac51866532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:35.713519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618175-5098-4e22-bcd7-e1ac51866532 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:35.713803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618175-5098-4e22-bcd7-e1ac51866532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:35.714079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8618175-5098-4e22-bcd7-e1ac51866532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:35.730390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8618175-5098-4e22-bcd7-e1ac51866532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:35.732041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8618175-5098-4e22-bcd7-e1ac51866532 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:35.769649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1247/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:36.400932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:36.403064 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:36.418596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572b30c-0aee-4399-bced-dfa428339e59 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:36.428880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:36.430244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:36.431764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:36.432385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] PATH_INFO: `/v3/projects/d7b95f958f4b442e861837ead5101cfc` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:36.433918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b95f958f4b442e861837ead5101cfc)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:36.438093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:36.477949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f67a9-77ff-4114-9955-78111167a2dc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:36.478872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f67a9-77ff-4114-9955-78111167a2dc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:36.479302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f67a9-77ff-4114-9955-78111167a2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:36.526503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ba9f67a9-77ff-4114-9955-78111167a2dc None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:36.528438 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ba9f67a9-77ff-4114-9955-78111167a2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:36.558676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b95f958f4b442e861837ead5101cfc', 'request_id': 'req-251970e9-affd-4c07-b916-340521c69887'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:36.587873 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b95f958f4b442e861837ead5101cfc', 'request_id': 'req-251970e9-affd-4c07-b916-340521c69887'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:36.596361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b95f958f4b442e861837ead5101cfc', 'request_id': 'req-251970e9-affd-4c07-b916-340521c69887'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:36.619484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] The token cache is being invalidate because project d7b95f958f4b442e861837ead5101cfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:15:36.619778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:36.622759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:36.635158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1231/2478] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:15:36 2022] DELETE /identity/v3/projects/d7b95f958f4b442e861837ead5101cfc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:36.731558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1248/2479] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:36.758573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:36.765587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:36.936576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251970e9-affd-4c07-b916-340521c69887 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:36.944233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe01c3b-87a2-4efc-b200-f5a5d2cd6c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:36.946530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01c3b-87a2-4efc-b200-f5a5d2cd6c7b service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:36.947904 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01c3b-87a2-4efc-b200-f5a5d2cd6c7b service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:36.950468 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe01c3b-87a2-4efc-b200-f5a5d2cd6c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:36.962550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe01c3b-87a2-4efc-b200-f5a5d2cd6c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:36.964397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe01c3b-87a2-4efc-b200-f5a5d2cd6c7b service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:36.979220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1232/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:39.792954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:39.793367 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:39.793514 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:39.795838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:39.796636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:39.796962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:39.826373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] MFA Rules not processed for user `37020900c19b4887b2b0628af754d388`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:39.827610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:39.836358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] MFA Rules not processed for user `9f56d4a83d8d47f2abe9b0aa77f178a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:39.837570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:39.856500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:39.929340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1249/2481] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:39.934356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:39.935826 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:39.942630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1233/2482] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:39.947478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:39.949785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:39.959281 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76680528-3c17-474a-98e2-5564af1447b7 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:39.965430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:39.966424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:39.967364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:39.968155 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:39.968982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:39.971070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:39.971282 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885134f-7f10-4b2f-b142-8c12530ccf5a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:39.976730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:39.977643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:39.978078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:39.978529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:39.979417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:39.981604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.012161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1250/2483] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:15:39 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:40.014162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.018497 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1234/2484] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:15:39 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:15:40.022233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.025470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:40.104873 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d5d48-0f33-45db-9673-ddb4ebdb5888 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.140952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b3411e-f652-4e2f-b393-4584486a0a37 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.161217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.161921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.162212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.162496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.164414 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.168676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.205822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1235/2485] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:15:40 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:40.210048 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.226507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1283-f8d0-428b-8555-8c16cc34a3aa admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.232161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.232997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.233368 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.233488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.233739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.234312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.234439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.234652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.234955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.235851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.236624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.237581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.268080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1236/2486] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:40.269077 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.270971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1251/2487] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:15:40 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:40.277758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.281491 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa7ec1-fe0a-4f49-99b8-0b6317c7707a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.290478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.291672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.292413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.292413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] PATH_INFO: `/v3/projects/ae3d922dc2a8438ca597fd09e925639a/users/c97a0361b9e9470d8b2daadf6d64519b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.296002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423074c1-aaa9-423b-857d-11597e93e0eb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.312333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.313086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.313304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.313583 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.314323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.315967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.316514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3d922dc2a8438ca597fd09e925639a, user_id=c97a0361b9e9470d8b2daadf6d64519b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.319602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.331369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1252/2488] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:40.333097 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.350163 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1237/2489] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:40 2022] PUT /identity/v3/projects/ae3d922dc2a8438ca597fd09e925639a/users/c97a0361b9e9470d8b2daadf6d64519b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:40.352227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.354774 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a02f0-d2a8-49a1-9219-1d0bee9bf549 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.426589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:40.442856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.444675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.444973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.445257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] PATH_INFO: `/v3/projects/f4231f03b0864f2ea4ca492b949e5e00/users/b610bd9801fa44d8a564273bff504683/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.466225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4231f03b0864f2ea4ca492b949e5e00, user_id=b610bd9801fa44d8a564273bff504683, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.469814 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.470777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baee168-33b3-4deb-a0e3-eb5bd744600f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.483885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.487514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.488590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.489097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.489870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.494503 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.497361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1253/2490] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:40 2022] PUT /identity/v3/projects/f4231f03b0864f2ea4ca492b949e5e00/users/b610bd9801fa44d8a564273bff504683/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:40.501296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.522955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1238/2491] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:40.524693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.543340 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:40.544836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3158ebe-29e9-455f-807f-5068c61fa00f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.643465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432ed88-b01c-4102-a156-cfbf5789914d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.655762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3002c14-0243-4b62-b5bc-e547d4f45e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.656631 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3002c14-0243-4b62-b5bc-e547d4f45e36 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.657002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3002c14-0243-4b62-b5bc-e547d4f45e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.657284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3002c14-0243-4b62-b5bc-e547d4f45e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.658029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3002c14-0243-4b62-b5bc-e547d4f45e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.659780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3002c14-0243-4b62-b5bc-e547d4f45e36 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.674019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1254/2492] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:40.675636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.675928 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.676206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.680631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.684170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.684739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.685230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] PATH_INFO: `/v3/projects/ae3d922dc2a8438ca597fd09e925639a/users/c97a0361b9e9470d8b2daadf6d64519b/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.692948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3d922dc2a8438ca597fd09e925639a, user_id=c97a0361b9e9470d8b2daadf6d64519b, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.696847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.709319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:40.712398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:40.712907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1239/2493] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:40 2022] PUT /identity/v3/projects/ae3d922dc2a8438ca597fd09e925639a/users/c97a0361b9e9470d8b2daadf6d64519b/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:40.716428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.828970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1255/2494] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:40.868082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:40.869820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:40.874661 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45167d3f-a252-41f2-a1e5-a90b58b0b477 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:40.882928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2723-ce78-4af2-8bec-7e932cb4a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:40.886420 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2723-ce78-4af2-8bec-7e932cb4a241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:40.886714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2723-ce78-4af2-8bec-7e932cb4a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:40.887019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2723-ce78-4af2-8bec-7e932cb4a241 admin admin] PATH_INFO: `/v3/projects/f4231f03b0864f2ea4ca492b949e5e00/users/b610bd9801fa44d8a564273bff504683/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:40.892477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc2723-ce78-4af2-8bec-7e932cb4a241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4231f03b0864f2ea4ca492b949e5e00, user_id=b610bd9801fa44d8a564273bff504683, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:40.895050 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc2723-ce78-4af2-8bec-7e932cb4a241 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:40.906981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1240/2495] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:40 2022] PUT /identity/v3/projects/f4231f03b0864f2ea4ca492b949e5e00/users/b610bd9801fa44d8a564273bff504683/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:41.021002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaa3ed-1e86-4c67-9bcd-8b55862c0b31 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:41.121396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:41.157549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:41.160060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:41.160734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:41.160734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:41.291410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:41.293816 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:41.308292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1256/2496] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:15:46.044877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5932ca-2cfe-4812-896d-f55448795606 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:46.045471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5932ca-2cfe-4812-896d-f55448795606 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:46.045875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5932ca-2cfe-4812-896d-f55448795606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:46.108071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-be5932ca-2cfe-4812-896d-f55448795606 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:46.109427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-be5932ca-2cfe-4812-896d-f55448795606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:46.141877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1241/2497] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:46.188373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:46.215040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb14f1-1665-4149-9242-23d7d9196812 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:46.242160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:46.242990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:46.243271 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:46.243540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:46.280677 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:46.282348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:46.328365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1257/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:47.926465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bf2db-346c-4762-8cf3-54bdb45037a9 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:47.927106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bf2db-346c-4762-8cf3-54bdb45037a9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:47.927106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bf2db-346c-4762-8cf3-54bdb45037a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:47.982535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fa7bf2db-346c-4762-8cf3-54bdb45037a9 None None] MFA Rules not processed for user `c97a0361b9e9470d8b2daadf6d64519b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:47.984024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fa7bf2db-346c-4762-8cf3-54bdb45037a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:48.059209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:48.085308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1242/2499] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:48.099148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:48.112791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:48.374359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8946e6-1350-4388-8eb6-e86a3bc108f4 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:48.393687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17da27-e24e-49db-95b1-9da765dabe05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8376ffaa09e2496a80fa60c979769d8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:48.394600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17da27-e24e-49db-95b1-9da765dabe05 service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:48.394923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17da27-e24e-49db-95b1-9da765dabe05 service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:48.395204 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17da27-e24e-49db-95b1-9da765dabe05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:48.444739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9007-ce77-4c1f-9a2b-c3cfe6d6b9ee None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:48.445033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9007-ce77-4c1f-9a2b-c3cfe6d6b9ee None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:48.445344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c9007-ce77-4c1f-9a2b-c3cfe6d6b9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:48.504994 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e73c9007-ce77-4c1f-9a2b-c3cfe6d6b9ee None None] MFA Rules not processed for user `b610bd9801fa44d8a564273bff504683`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:48.506882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e73c9007-ce77-4c1f-9a2b-c3cfe6d6b9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:48.510315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17da27-e24e-49db-95b1-9da765dabe05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:48.511835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17da27-e24e-49db-95b1-9da765dabe05 service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:48.522921 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1258/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:48.666625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1243/2501] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:48.670613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:48.670960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:48.671229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:48.675720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c9007-ce77-4c1f-9a2b-c3cfe6d6b9ee None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:48.688847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:48.690046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c9007-ce77-4c1f-9a2b-c3cfe6d6b9ee None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:48.699863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:48.702660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:48.706751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:48.707564 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:48.707958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:48.708362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:48.831805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:48.834009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:48.846324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1244/2502] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:48.853089 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1259/2503] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:15:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:48.863388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:48.872149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:48.876534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:48.878065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:48.924068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bb22f-713c-4016-a162-2936a8e9f530 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:48.937770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:48.966995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:48.967522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:48.968015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] PATH_INFO: `/v3/users/c44db6f008504d8a900b7bf897baff0f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:48.971878 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44db6f008504d8a900b7bf897baff0f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:48.980940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:49.044256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce638f20-d5ac-4154-a35a-d3ba4a8fd180 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:49.053020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3eb44b-e113-4cc0-b883-f2acf559f64c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:49.054226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eb44b-e113-4cc0-b883-f2acf559f64c service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:49.055144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eb44b-e113-4cc0-b883-f2acf559f64c service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:49.057648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3eb44b-e113-4cc0-b883-f2acf559f64c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:49.092706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3eb44b-e113-4cc0-b883-f2acf559f64c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:49.095368 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3eb44b-e113-4cc0-b883-f2acf559f64c service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:49.129095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1260/2504] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:15:49.129708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44db6f008504d8a900b7bf897baff0f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:49.136844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44db6f008504d8a900b7bf897baff0f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:49.137798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44db6f008504d8a900b7bf897baff0f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:49.149632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44db6f008504d8a900b7bf897baff0f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:49.180927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:49.183300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44db6f008504d8a900b7bf897baff0f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:49.221086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1245/2505] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:15:48 2022] DELETE /identity/v3/users/c44db6f008504d8a900b7bf897baff0f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:49.228531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:49.228531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:49.228942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:49.277306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:49.279076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:49.444045 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1261/2506] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:49.455681 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:49.457312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:49.625301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372238aa-5896-4400-ace8-3fb123bb657a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:49.642487 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa5ef5-e9bb-4675-95c4-e659e383ba73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:49.646023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa5ef5-e9bb-4675-95c4-e659e383ba73 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:49.646023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa5ef5-e9bb-4675-95c4-e659e383ba73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:49.647522 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa5ef5-e9bb-4675-95c4-e659e383ba73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:49.682583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa5ef5-e9bb-4675-95c4-e659e383ba73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:49.696790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa5ef5-e9bb-4675-95c4-e659e383ba73 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:49.734671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1246/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:50.459378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:50.462228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:50.481383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0687c-6fe2-40a6-a2a9-a8c58003ad03 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:50.488565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:50.489616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:50.490141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:50.494772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:50.494772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:50.494772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:50.495473 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] PATH_INFO: `/v3/projects/5463c66da68a48c9a3c540a184e36ab0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:50.507244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5463c66da68a48c9a3c540a184e36ab0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:50.511897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:50.528219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:50.531281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:50.554828 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1247/2508] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:50.575726 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:50.578602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:50.619797 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:50.644810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5463c66da68a48c9a3c540a184e36ab0', 'request_id': 'req-0ee392dc-b615-4c1a-a4d1-277f32f2403b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:50.675619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5463c66da68a48c9a3c540a184e36ab0', 'request_id': 'req-0ee392dc-b615-4c1a-a4d1-277f32f2403b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:50.702563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5463c66da68a48c9a3c540a184e36ab0', 'request_id': 'req-0ee392dc-b615-4c1a-a4d1-277f32f2403b'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:50.740919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] The token cache is being invalidate because project 5463c66da68a48c9a3c540a184e36ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:15:50.741218 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:50.742227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-0ee392dc-b615-4c1a-a4d1-277f32f2403b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:15:50.750277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1262/2509] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:15:50 2022] DELETE /identity/v3/projects/5463c66da68a48c9a3c540a184e36ab0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:50.752523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061885a-2934-4a1f-8180-56726876e902 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:50.753149 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061885a-2934-4a1f-8180-56726876e902 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:50.753829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061885a-2934-4a1f-8180-56726876e902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:50.789129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e061885a-2934-4a1f-8180-56726876e902 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:50.790872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e061885a-2934-4a1f-8180-56726876e902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:50.821652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f96f6f-bd0e-4ed6-83a1-bfb124a971e2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:50.924273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1263/2510] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:50.933963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd5a36-d756-40d4-86b6-087a8079e422 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:50.934528 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd5a36-d756-40d4-86b6-087a8079e422 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:50.935104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd5a36-d756-40d4-86b6-087a8079e422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:50.979807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c75e18f-7072-45d0-a195-f4598c4f4cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:50.980257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e18f-7072-45d0-a195-f4598c4f4cb2 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:50.980579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e18f-7072-45d0-a195-f4598c4f4cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:50.980858 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c75e18f-7072-45d0-a195-f4598c4f4cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:50.983136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8c75e18f-7072-45d0-a195-f4598c4f4cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:50.987260 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2dbd5a36-d756-40d4-86b6-087a8079e422 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:50.991753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2dbd5a36-d756-40d4-86b6-087a8079e422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:51.005406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75e18f-7072-45d0-a195-f4598c4f4cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:51.008894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c75e18f-7072-45d0-a195-f4598c4f4cb2 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:51.024795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1264/2511] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:15:51.026927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd5a36-d756-40d4-86b6-087a8079e422 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:51.027880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1248/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:51.029913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1cac-582f-4832-a528-a8c62f7b613c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.030277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1cac-582f-4832-a528-a8c62f7b613c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.030563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa1cac-582f-4832-a528-a8c62f7b613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.046709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:51.050449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd5a36-d756-40d4-86b6-087a8079e422 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:51.054312 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-62fa1cac-582f-4832-a528-a8c62f7b613c None None] MFA Rules not processed for user `37020900c19b4887b2b0628af754d388`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:51.056168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-62fa1cac-582f-4832-a528-a8c62f7b613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:51.061576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:51.062276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.062763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.064070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.064070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:15:51.064282 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:51.068543 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:51.091351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1265/2513] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:15:51.097644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:51.162021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0310f6b-0079-4b1a-95ec-2e2975932b21 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:51.183513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:51.184777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.186252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.186712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.187590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:51.190564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:51.222691 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1266/2514] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:15:51 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:15:51.228164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:51.294056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1249/2515] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:51.351378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4e68a-b19f-4623-99c0-49e48fde8610 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:51.356134 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:51.356846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.357137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.357417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.358252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:51.360257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:51.390731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1267/2516] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:15:51 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:15:51.394941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1cac-582f-4832-a528-a8c62f7b613c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:51.408070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa1cac-582f-4832-a528-a8c62f7b613c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:51.414051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:51.415069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.415204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.415720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.416470 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:51.420202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:51.434624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1250/2517] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:51.436571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:51.447379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022629b2-172f-453c-a75b-5ded7fcb445e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:51.454335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f0750c-1053-4884-90f7-fd416f87a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:51.454335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0750c-1053-4884-90f7-fd416f87a231 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.454335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0750c-1053-4884-90f7-fd416f87a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.454694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f0750c-1053-4884-90f7-fd416f87a231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.455613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0750c-1053-4884-90f7-fd416f87a231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:51.457399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f0750c-1053-4884-90f7-fd416f87a231 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:51.473102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1268/2518] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:15:51.474176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:51.491761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e6431-52c2-435f-8cd8-b6533e48391b admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:51.506099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:51.507899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.508264 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.508633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] PATH_INFO: `/v3/projects/efa2ddeb51f84c9fb5274bfa8f5135b2/users/08538bb3d7824e3cb5e733f089eee214/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.546627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa2ddeb51f84c9fb5274bfa8f5135b2, user_id=08538bb3d7824e3cb5e733f089eee214, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:51.562949 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:51.583276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1251/2519] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:15:51 2022] PUT /identity/v3/projects/efa2ddeb51f84c9fb5274bfa8f5135b2/users/08538bb3d7824e3cb5e733f089eee214/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:15:51.597860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:51.598175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:51.598459 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:51.606287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:15:51.702313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] MFA Rules not processed for user `08538bb3d7824e3cb5e733f089eee214`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:15:51.707064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:51.870432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1269/2520] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:15:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:15:51.880254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:51.883055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:52.017089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a1b74-eb9d-41ea-aab0-eafc9e758159 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:52.031488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b29d31-f731-4191-8489-200e7504f9bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:52.032298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b29d31-f731-4191-8489-200e7504f9bc service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:52.032694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b29d31-f731-4191-8489-200e7504f9bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:52.033068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b29d31-f731-4191-8489-200e7504f9bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:52.051960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b29d31-f731-4191-8489-200e7504f9bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:52.056915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b29d31-f731-4191-8489-200e7504f9bc service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:52.081776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1252/2521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:15:56.741606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:15:56.745249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:57.079323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44689a81-bc54-4c00-94be-6b7628165274 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:15:57.086355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:15:57.087930 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:15:57.088439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:15:57.088871 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:15:57.102078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:15:57.123742 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:15:57.125371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:15:57.171927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1270/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:15:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:16:02.071429 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=63,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:03.323201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a211b-a7ce-4e74-ae0a-d7c546e1f14f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:03.323809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a211b-a7ce-4e74-ae0a-d7c546e1f14f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:03.323809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a211b-a7ce-4e74-ae0a-d7c546e1f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:03.341609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-104a211b-a7ce-4e74-ae0a-d7c546e1f14f None None] MFA Rules not processed for user `9f56d4a83d8d47f2abe9b0aa77f178a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:03.343020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-104a211b-a7ce-4e74-ae0a-d7c546e1f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:03.403968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1253/2523] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:16:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:03.998379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:04.067948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7bd43c-8e61-4c7b-8bff-3c84ccdbb76c service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:04.072588 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:04.073470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:04.073757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:04.074040 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] PATH_INFO: `/v3/users/08538bb3d7824e3cb5e733f089eee214` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:04.075907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] RBAC: Authorizing `identity:delete_user(user_id=08538bb3d7824e3cb5e733f089eee214)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:04.077836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:04.080348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=100 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:04.135384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08538bb3d7824e3cb5e733f089eee214'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:04.142589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08538bb3d7824e3cb5e733f089eee214'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:04.143854 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08538bb3d7824e3cb5e733f089eee214'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:04.162074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08538bb3d7824e3cb5e733f089eee214'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:04.166409 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08538bb3d7824e3cb5e733f089eee214'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:04.188436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1271/2524] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:16:03 2022] DELETE /identity/v3/users/08538bb3d7824e3cb5e733f089eee214 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:16:04.194233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf531-236a-4623-9759-551d3e53e896 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:04.194666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf531-236a-4623-9759-551d3e53e896 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:04.195099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458bf531-236a-4623-9759-551d3e53e896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:04.216071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-458bf531-236a-4623-9759-551d3e53e896 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:04.217631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-458bf531-236a-4623-9759-551d3e53e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:04.318216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1254/2525] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:04.338737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:04.340436 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:04.416328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe55d55-c99d-4c9f-b96d-d0551623c1de admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:04.424676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bf49f-cf8e-4043-b2d0-d53a62cadafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:04.425550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf49f-cf8e-4043-b2d0-d53a62cadafd service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:04.425852 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf49f-cf8e-4043-b2d0-d53a62cadafd service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:04.426270 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bf49f-cf8e-4043-b2d0-d53a62cadafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:04.439185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf49f-cf8e-4043-b2d0-d53a62cadafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:04.440645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bf49f-cf8e-4043-b2d0-d53a62cadafd service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:04.451165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1272/2526] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:16:04.970921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf531-236a-4623-9759-551d3e53e896 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:04.972391 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-458bf531-236a-4623-9759-551d3e53e896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:04.984257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458bf531-236a-4623-9759-551d3e53e896 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:04.988929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:04.989786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:04.990066 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:04.990338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] PATH_INFO: `/v3/projects/efa2ddeb51f84c9fb5274bfa8f5135b2` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:04.991656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa2ddeb51f84c9fb5274bfa8f5135b2)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:04.993708 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:05.044279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa2ddeb51f84c9fb5274bfa8f5135b2', 'request_id': 'req-9e5832c5-4ba3-498c-b91b-63e17cff142f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:05.051422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa2ddeb51f84c9fb5274bfa8f5135b2', 'request_id': 'req-9e5832c5-4ba3-498c-b91b-63e17cff142f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:05.057353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa2ddeb51f84c9fb5274bfa8f5135b2', 'request_id': 'req-9e5832c5-4ba3-498c-b91b-63e17cff142f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:05.068297 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] The token cache is being invalidate because project efa2ddeb51f84c9fb5274bfa8f5135b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:16:05.068587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:05.069322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:16:05.070885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1255/2527] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:16:04 2022] DELETE /identity/v3/projects/efa2ddeb51f84c9fb5274bfa8f5135b2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:16:05.556732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843714f8-8170-474f-a169-077599d56804 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:05.557250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843714f8-8170-474f-a169-077599d56804 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:05.557381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843714f8-8170-474f-a169-077599d56804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:05.576527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-843714f8-8170-474f-a169-077599d56804 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:05.577776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-843714f8-8170-474f-a169-077599d56804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:05.644237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1273/2528] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:16:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:05.666277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:05.667808 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:05.704997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:05.756640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5832c5-4ba3-498c-b91b-63e17cff142f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:05.761978 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:05.762672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:05.763103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:05.763396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:05.772377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:05.774281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:05.783998 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1256/2529] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:16:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:16:09.524241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:09.524770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:09.524972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:09.544123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] MFA Rules not processed for user `8752518799cd41198dbefb88e3237535`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:09.544936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:09.571023 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:09.616033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1274/2530] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:16:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:15.781111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=19 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:19.607770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=12 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:16:36.710622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:36.712257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:36.788711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bd98bb-a5da-4a6a-ac7d-c5916a0ae885 service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:36.792313 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c0bef-f2ff-4537-b963-192491bd93d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:36.793005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0bef-f2ff-4537-b963-192491bd93d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:36.793284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0bef-f2ff-4537-b963-192491bd93d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:36.793568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0bef-f2ff-4537-b963-192491bd93d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:36.795387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-2e9c0bef-f2ff-4537-b963-192491bd93d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:36.865155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c0bef-f2ff-4537-b963-192491bd93d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:36.866725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c0bef-f2ff-4537-b963-192491bd93d9 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:36.877379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1257/2531] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:16:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:16:40.140111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:40.141540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:40.153568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a679786-baa6-415d-8b7a-7662af6abe31 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:40.156990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:40.157623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:40.157905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:40.158176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:40.159881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:40.222818 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:40.224889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:40.235599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1275/2532] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:16:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:16:44.413392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847c55-26e5-4266-84b2-4f97d5fe33a0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:44.414013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847c55-26e5-4266-84b2-4f97d5fe33a0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:44.414013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29847c55-26e5-4266-84b2-4f97d5fe33a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:44.432416 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-29847c55-26e5-4266-84b2-4f97d5fe33a0 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:44.434569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-29847c55-26e5-4266-84b2-4f97d5fe33a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:44.492798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1258/2533] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:44.507254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:44.508610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:44.583752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab9903-e793-430d-b71f-ebc6f0e612d6 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:44.589081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:44.589746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:44.590024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:44.590293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:44.598220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:44.599813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:44.608950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1276/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:16:48.694300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc05f6-b13f-4a20-99b5-cbf4c3b52093 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:48.694812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc05f6-b13f-4a20-99b5-cbf4c3b52093 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:48.694812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc05f6-b13f-4a20-99b5-cbf4c3b52093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:48.713179 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-befc05f6-b13f-4a20-99b5-cbf4c3b52093 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:48.714373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-befc05f6-b13f-4a20-99b5-cbf4c3b52093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:48.722319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1259/2535] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:48.747318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:48.748741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:48.764466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200cc0f4-6e45-4dee-984b-89a77572b23f service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:48.770056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:48.770685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:48.771009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:48.771292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:48.779620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:48.781196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:48.790705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1277/2536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:16:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:16:52.784789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7675-60cb-44a7-9ec7-c82d12c4ebdb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:52.785276 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7675-60cb-44a7-9ec7-c82d12c4ebdb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:52.785386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf7675-60cb-44a7-9ec7-c82d12c4ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:52.802855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-e7cf7675-60cb-44a7-9ec7-c82d12c4ebdb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:52.804039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e7cf7675-60cb-44a7-9ec7-c82d12c4ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:52.812117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1260/2537] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:52.830410 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:52.841556 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb1acc-9c94-478a-866b-27d210a0e337 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:52.847216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:52.847848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:52.848127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:52.848426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:52.857248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:52.858802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:52.868444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1278/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:16:56.962968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90c68f-8238-4914-9320-72655ce3daf9 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:56.963488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90c68f-8238-4914-9320-72655ce3daf9 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:56.963601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa90c68f-8238-4914-9320-72655ce3daf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:56.982081 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-aa90c68f-8238-4914-9320-72655ce3daf9 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:16:56.983344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-aa90c68f-8238-4914-9320-72655ce3daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:16:56.991385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1261/2539] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:16:57.021681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:16:57.032807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c974c2f-ff93-425a-ac36-7931897ac60d service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:16:57.038504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:16:57.039170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:16:57.039453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:16:57.039725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:16:57.048923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:16:57.050575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:16:57.060789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1279/2540] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:17:01.148394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:17:01.148884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:17:01.148986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:17:01.167350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:17:01.168579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:17:01.176368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1262/2541] 10.222.0.15 () {58 vars in 1016 bytes} [Thu May 26 20:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:17:01.193977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:17:01.205910 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e7b1d-d644-4d56-bc23-21093dd48e1a service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:17:01.211433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:17:01.212075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:17:01.212389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:17:01.212669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:17:01.221033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:17:01.222661 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:17:01.232141 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1280/2542] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:17:11.162219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:17:11.227836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:17:32.149781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:17:32.152058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:17:32.166102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8799fef3-7355-4bb2-8a92-8f51aacc6e2c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:17:32.170712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:17:32.171587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:17:32.171869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:17:32.172142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] PATH_INFO: `/v3/users/8752518799cd41198dbefb88e3237535` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:17:32.173398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8752518799cd41198dbefb88e3237535)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:17:32.175338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:17:32.222402 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8752518799cd41198dbefb88e3237535'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.223080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8752518799cd41198dbefb88e3237535'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.223687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8752518799cd41198dbefb88e3237535'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.230566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8752518799cd41198dbefb88e3237535'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.242053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6cd237d4-7b0f-4c4d-8733-6116c3576da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8752518799cd41198dbefb88e3237535'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.257977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1263/2543] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:17:32 2022] DELETE /identity/v3/users/8752518799cd41198dbefb88e3237535 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:17:32.432165 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:17:32.449095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df13dff-3ef7-43af-8cb4-aaa39113febb service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:17:32.511784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:17:32.512655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:17:32.512934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:17:32.513208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] PATH_INFO: `/v3/projects/ed9ad3e79f45442b9e41cce6f19d11d2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:17:32.514396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9ad3e79f45442b9e41cce6f19d11d2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:17:32.516324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:17:32.569613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9ad3e79f45442b9e41cce6f19d11d2', 'request_id': 'req-e1204c23-a26e-4b32-bf24-897bcd9dddb8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.579419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9ad3e79f45442b9e41cce6f19d11d2', 'request_id': 'req-e1204c23-a26e-4b32-bf24-897bcd9dddb8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.585694 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9ad3e79f45442b9e41cce6f19d11d2', 'request_id': 'req-e1204c23-a26e-4b32-bf24-897bcd9dddb8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.598462 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] The token cache is being invalidate because project ed9ad3e79f45442b9e41cce6f19d11d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:17:32.598753 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.599613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:17:32.601632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1281/2544] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:17:32 2022] DELETE /identity/v3/projects/ed9ad3e79f45442b9e41cce6f19d11d2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:17:32.782353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c835fa8-f085-456b-a65a-ff539f58b48d None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:17:32.782674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c835fa8-f085-456b-a65a-ff539f58b48d None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:17:32.782999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c835fa8-f085-456b-a65a-ff539f58b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:17:32.801339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1c835fa8-f085-456b-a65a-ff539f58b48d None None] MFA Rules not processed for user `13a00d0c317a4e69aa84b3851d5f0424`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:17:32.802542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1c835fa8-f085-456b-a65a-ff539f58b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:17:32.857637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1264/2545] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:17:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:17:42.595419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:17:42.849965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:18:10.062313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:10.063771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:10.122293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1204c23-a26e-4b32-bf24-897bcd9dddb8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:10.125912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:10.127061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:10.127061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:10.127285 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:10.129003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:10.210207 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:10.211674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:10.222540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1282/2546] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:11.405033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c835fa8-f085-456b-a65a-ff539f58b48d None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:11.414530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c835fa8-f085-456b-a65a-ff539f58b48d None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:11.418670 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:11.419344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:11.419627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:11.419899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:11.421639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:11.434658 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:11.436107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:11.450016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1265/2547] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:20.217650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=54 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:18:21.443863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=6 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:18:36.214258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:36.215831 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:36.270749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c527739-46ff-4b83-b564-496171c5ebf8 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:36.274326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:36.275000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:36.275284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:36.275562 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:36.277283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:36.287901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:36.289321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:36.298148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1283/2548] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:36.409058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:36.418373 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99cb88-a372-4764-80d0-31960c48af9a service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:36.422136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd09d7-adbe-415a-89ec-386208656a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:36.423148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd09d7-adbe-415a-89ec-386208656a04 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:36.423494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd09d7-adbe-415a-89ec-386208656a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:36.423832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd09d7-adbe-415a-89ec-386208656a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:36.425672 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-01cd09d7-adbe-415a-89ec-386208656a04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:36.486341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd09d7-adbe-415a-89ec-386208656a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:36.487804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd09d7-adbe-415a-89ec-386208656a04 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:36.496736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1266/2549] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:39.866071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:39.867859 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:39.890876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e129e9e-1cdf-4195-94c5-8cfe8c377d94 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:39.897876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:39.899173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:39.911701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:39.912344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:39.914215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:39.951154 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:39.953641 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:39.984178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1284/2550] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:45.847396 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:45.847935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:45.847935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:45.866747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] MFA Rules not processed for user `8e15218966314337ae4d70e374bd4bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:18:45.867981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:45.876191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1267/2551] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:18:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:18:46.194966 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:46.204889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06321e65-4332-42ef-bf9e-ea34702b3f77 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:46.208486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:46.209169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:46.209467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:46.209751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:46.211592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:46.221395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:46.222829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:46.231633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1285/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:46.560730 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:46.562413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:46.643544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d475c-3f39-4d4a-9ce5-2e0f9c787866 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:46.649229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:46.649881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:46.650171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:46.650447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:46.652235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:46.664576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:46.666319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:46.678693 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1268/2553] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:48.349497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:48.351080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:48.362030 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8beb5b-0644-4601-8ca6-d18c9c756f08 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:48.365781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:48.366425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:48.366704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:48.367022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:48.368902 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:48.380864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:48.382373 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:48.391455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1286/2554] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:51.000542 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:51.012572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968481ec-6554-49a3-8744-e52bc0567547 service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:51.018014 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:51.018643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:51.018965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:51.019245 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:51.020997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:51.034112 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:51.035357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:51.046565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1269/2555] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:57.061353 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:57.090383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf79f50-252b-4fc6-bd42-cc5128dc3cd8 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:57.099388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:57.100062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:57.100346 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:57.100617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:57.102450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:57.122284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:57.124003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:57.141450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1287/2556] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:18:57.334300 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:18:57.343562 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fdb7af-233f-4e6d-9d3c-fb156718a462 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:18:57.347339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:18:57.347990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:18:57.348273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:18:57.348548 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:18:57.350327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:18:57.413172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:18:57.414597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:18:57.424550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1270/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:19:00.736685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:00.738538 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:00.746969 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=51 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:00.755156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa44920-0faa-46d2-925d-59087e436d1f service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:00.760713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:00.761370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:00.761657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:00.761937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:00.764261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:00.781940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:00.784102 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:00.798979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1288/2558] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:19:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:19:00.829585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:00.831020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:00.838063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:00.853645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ef702-42c2-47a1-badc-3be34aaa7e0d service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:00.865534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:00.867270 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:00.867737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:00.868176 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] PATH_INFO: `/v3/users/13a00d0c317a4e69aa84b3851d5f0424` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:00.870292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a00d0c317a4e69aa84b3851d5f0424)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:00.873488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:00.926326 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a00d0c317a4e69aa84b3851d5f0424'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:00.927540 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a00d0c317a4e69aa84b3851d5f0424'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:00.928153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a00d0c317a4e69aa84b3851d5f0424'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:00.936989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a00d0c317a4e69aa84b3851d5f0424'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:00.953602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-f49794e3-a2e6-4ddf-9463-f3c51b84c1ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a00d0c317a4e69aa84b3851d5f0424'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:00.967381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1271/2559] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:19:00 2022] DELETE /identity/v3/users/13a00d0c317a4e69aa84b3851d5f0424 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:19:01.172654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:01.189044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368c49dc-3383-4d41-abcd-3ae4838ac823 service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:01.274126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:01.275119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.275507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.276017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] PATH_INFO: `/v3/projects/a27e083cb6b845fea8b7a2cee00ee34f` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.278132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a27e083cb6b845fea8b7a2cee00ee34f)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:01.280277 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:01.337552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a27e083cb6b845fea8b7a2cee00ee34f', 'request_id': 'req-128265f9-bbbb-4888-9d0d-6c66081a93d0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:01.343495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a27e083cb6b845fea8b7a2cee00ee34f', 'request_id': 'req-128265f9-bbbb-4888-9d0d-6c66081a93d0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:01.354827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a27e083cb6b845fea8b7a2cee00ee34f', 'request_id': 'req-128265f9-bbbb-4888-9d0d-6c66081a93d0'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:01.370205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] The token cache is being invalidate because project a27e083cb6b845fea8b7a2cee00ee34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:19:01.370496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:01.371145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-128265f9-bbbb-4888-9d0d-6c66081a93d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:01.372913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1289/2560] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:19:01 2022] DELETE /identity/v3/projects/a27e083cb6b845fea8b7a2cee00ee34f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:19:01.378703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2142145-d466-49e9-b80d-fb2ff43a004b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.379223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2142145-d466-49e9-b80d-fb2ff43a004b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.379565 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2142145-d466-49e9-b80d-fb2ff43a004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.401067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a2142145-d466-49e9-b80d-fb2ff43a004b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:01.402362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a2142145-d466-49e9-b80d-fb2ff43a004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:01.469745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1272/2561] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:19:01.478075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f6f6-b20b-4168-8109-b40407208b4e None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.478365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f6f6-b20b-4168-8109-b40407208b4e None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.478642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f6f6-b20b-4168-8109-b40407208b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.501887 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-81b1f6f6-b20b-4168-8109-b40407208b4e None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:01.503239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-81b1f6f6-b20b-4168-8109-b40407208b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:01.520079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1290/2562] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:19:01.521492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2142145-d466-49e9-b80d-fb2ff43a004b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:01.534832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2142145-d466-49e9-b80d-fb2ff43a004b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:01.539822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:01.540485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.540923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.541759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.543004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:19:01.543465 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:01.545614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:01.564356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1f6f6-b20b-4168-8109-b40407208b4e None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:01.566943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1273/2563] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:19:01.576347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1f6f6-b20b-4168-8109-b40407208b4e None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:01.584077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:01.585153 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.585684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.585973 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.586676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:01.589211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:01.642868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1291/2564] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:19:01 2022] POST /identity/v3/projects => generated 389 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:19:01.646482 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:01.658308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5ce3d-66a6-4533-b256-4aa38eecddf7 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:01.729454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:01.730424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.730965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.731404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.732275 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:01.734802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:01.743239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:01.764825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1274/2565] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:19:01 2022] POST /identity/v3/users => generated 295 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:19:01.766943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:01.778503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67fbd0f-b771-46e1-8607-1e86b26b9008 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:01.785406 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:01.786221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.786607 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.787025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.787968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:01.789734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:01.801597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1292/2566] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:19:01.806287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:01.820765 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76cb28c-87d9-407c-9427-dd5e14fbbe70 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:01.826257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ceed57-b4e1-4423-b81d-34b81fbfd20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:01.827156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceed57-b4e1-4423-b81d-34b81fbfd20e admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.827443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceed57-b4e1-4423-b81d-34b81fbfd20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.828846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ceed57-b4e1-4423-b81d-34b81fbfd20e admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.829274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceed57-b4e1-4423-b81d-34b81fbfd20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:01.831989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ceed57-b4e1-4423-b81d-34b81fbfd20e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:01.844484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1275/2567] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:19:01.848668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:01.859144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa48727-3cab-4386-9d29-ac17bd7fc291 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:01.863972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:01.864955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.865310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.865597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] PATH_INFO: `/v3/projects/9e673ed28df546b28e1dcd82509bb012/users/7972412da00a4efe9df95922ebe1ef4e/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.882201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e673ed28df546b28e1dcd82509bb012, user_id=7972412da00a4efe9df95922ebe1ef4e, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:01.884825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:01.898646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1293/2568] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:19:01 2022] PUT /identity/v3/projects/9e673ed28df546b28e1dcd82509bb012/users/7972412da00a4efe9df95922ebe1ef4e/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:19:01.904753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ee72d-5414-4c0c-b2f9-b2c71c5bde52 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:01.905226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ee72d-5414-4c0c-b2f9-b2c71c5bde52 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:01.905574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ee72d-5414-4c0c-b2f9-b2c71c5bde52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:01.933640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-985ee72d-5414-4c0c-b2f9-b2c71c5bde52 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:01.935084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-985ee72d-5414-4c0c-b2f9-b2c71c5bde52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:02.000922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1276/2569] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:19:02.010513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:02.012303 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:02.022785 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:02.079829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3023ca-fbf5-461d-9dc0-f1d13dd7cc22 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:02.084303 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:02.085167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:02.085611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:02.086051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:02.096730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:02.098258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:02.108748 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1294/2570] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:19:06.088269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d75f-ab3b-48e3-b86d-409e49a1289e None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:06.088747 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d75f-ab3b-48e3-b86d-409e49a1289e None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:06.088867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9d75f-ab3b-48e3-b86d-409e49a1289e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:06.117111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ada9d75f-ab3b-48e3-b86d-409e49a1289e None None] MFA Rules not processed for user `7972412da00a4efe9df95922ebe1ef4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:06.118195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ada9d75f-ab3b-48e3-b86d-409e49a1289e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:06.189118 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1277/2571] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:19:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:19:06.204047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:06.205569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:06.283061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076381fc-43e6-423f-8fed-e7348777a532 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:06.288536 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:06.289194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:06.289484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:06.289762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:06.298874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:06.300487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:06.310548 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1295/2572] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:19:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:19:07.607356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bb401-2a4c-4f66-935a-3a2a80ada439 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:07.607892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bb401-2a4c-4f66-935a-3a2a80ada439 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:07.607980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5bb401-2a4c-4f66-935a-3a2a80ada439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:07.626546 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7f5bb401-2a4c-4f66-935a-3a2a80ada439 None None] MFA Rules not processed for user `7972412da00a4efe9df95922ebe1ef4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:07.627819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7f5bb401-2a4c-4f66-935a-3a2a80ada439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:07.635352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1278/2573] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:19:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:19:07.949646 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:07.951662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:07.966789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643b5230-5ebe-4c39-b962-79ac5c3dba42 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:07.970500 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:07.971177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:07.971460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:07.971761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:07.973532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:07.983496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:07.985518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:07.993847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1296/2574] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:19:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:19:17.620327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:INSERT=2,keystone:SELECT=69 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:17.990702 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=63 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:28.828037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:28.828513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:28.828608 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:28.848223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:28.849411 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:28.903255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1279/2575] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 20:19:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:19:28.943337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:28.944757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:29.012362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d557d8-c0aa-4aac-839c-58c78db92461 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:29.017846 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:29.018488 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:29.018777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:29.019084 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:29.027130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:29.028707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:29.037209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1297/2576] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:19:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:19:32.826629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:32.828720 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:32.925696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2a961-7efb-4455-b0b4-e7d45bb2e4db None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:32.932675 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:32.933585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:32.934103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:32.934555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:32.936938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:32.953336 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:32.954989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:32.965842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1280/2577] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:19:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:19:36.031618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:36.033756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.050886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849753f2-da67-4936-97c6-fead22a84937 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:36.055667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:36.056570 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.056845 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.057116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] PATH_INFO: `/v3/users/9f56d4a83d8d47f2abe9b0aa77f178a5` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.058313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f56d4a83d8d47f2abe9b0aa77f178a5)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:36.060240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:36.107564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f56d4a83d8d47f2abe9b0aa77f178a5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.115821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f56d4a83d8d47f2abe9b0aa77f178a5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.116507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f56d4a83d8d47f2abe9b0aa77f178a5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.128524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f56d4a83d8d47f2abe9b0aa77f178a5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.129178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-371b092b-3ccc-4c86-b109-c3351369b4be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f56d4a83d8d47f2abe9b0aa77f178a5'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.142502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1298/2578] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:19:36 2022] DELETE /identity/v3/users/9f56d4a83d8d47f2abe9b0aa77f178a5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:19:36.320322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:36.333360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b48b-55f2-42c9-bef1-ec076dd1e65d service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:36.341343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d840c4-716b-4a85-a4a8-405ff3e12424 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.341666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d840c4-716b-4a85-a4a8-405ff3e12424 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.342016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d840c4-716b-4a85-a4a8-405ff3e12424 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.344490 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1299/2579] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:19:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:19:36.353300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.353673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.354015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.377674 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] MFA Rules not processed for user `8751982010ae4b7eb6c855aea7540a23`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:36.381706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.402443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:36.403445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.403735 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.404019 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] PATH_INFO: `/v3/projects/969e353aca654e2ea45582104df1f419` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.405690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=969e353aca654e2ea45582104df1f419)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:36.408233 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:36.445259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1300/2580] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:19:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:19:36.458679 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:36.461554 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:36.464109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.469244 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969e353aca654e2ea45582104df1f419', 'request_id': 'req-750e5f79-337f-4a18-af5e-f36b075ff973'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.478187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f83bd-b246-4c28-af71-a918c6d1fca5 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:36.478403 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969e353aca654e2ea45582104df1f419', 'request_id': 'req-750e5f79-337f-4a18-af5e-f36b075ff973'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.485215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969e353aca654e2ea45582104df1f419', 'request_id': 'req-750e5f79-337f-4a18-af5e-f36b075ff973'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.489183 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:36.500221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] The token cache is being invalidate because project 969e353aca654e2ea45582104df1f419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:19:36.500606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.501352 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.503041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1281/2581] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:19:36 2022] DELETE /identity/v3/projects/969e353aca654e2ea45582104df1f419 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:19:36.506697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:36.508108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.534209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1872ac-a9e0-440e-95f0-4599faa8e516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:36.534807 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1872ac-a9e0-440e-95f0-4599faa8e516 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.535116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1872ac-a9e0-440e-95f0-4599faa8e516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.535392 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1872ac-a9e0-440e-95f0-4599faa8e516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.537162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7b1872ac-a9e0-440e-95f0-4599faa8e516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.547286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1872ac-a9e0-440e-95f0-4599faa8e516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:36.548744 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1872ac-a9e0-440e-95f0-4599faa8e516 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:36.557125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1301/2582] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:19:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:19:36.572989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e5f79-337f-4a18-af5e-f36b075ff973 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:36.577700 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:36.578579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.578886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.579228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] PATH_INFO: `/v3/users/c97a0361b9e9470d8b2daadf6d64519b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.580990 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97a0361b9e9470d8b2daadf6d64519b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:36.582953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:36.637561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97a0361b9e9470d8b2daadf6d64519b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.638254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97a0361b9e9470d8b2daadf6d64519b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.639031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97a0361b9e9470d8b2daadf6d64519b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.647009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97a0361b9e9470d8b2daadf6d64519b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.649399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b2e88-6f54-43cc-9159-6040ca6bf635 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.649693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b2e88-6f54-43cc-9159-6040ca6bf635 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.649975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b2e88-6f54-43cc-9159-6040ca6bf635 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.651371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1302/2583] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 20:19:36.656817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.657107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.657416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.659261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97a0361b9e9470d8b2daadf6d64519b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:36.673656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1282/2584] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:19:36 2022] DELETE /identity/v3/users/c97a0361b9e9470d8b2daadf6d64519b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:19:36.697655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:19:36.698882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.769463 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1303/2585] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:19:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:19:36.779968 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:36.781430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.831156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:36.848068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a7cb0-1ca9-46ef-b399-7e3d6af47d39 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:36.849093 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:19:36.850734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:19:36.856044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:36.856716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.857003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.857284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.868440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:36.869882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:36.882029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1283/2586] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:19:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:19:36.951660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7847441-e8b1-48f4-99f4-e75e9b657781 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:19:36.956379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:19:36.957322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:19:36.957676 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:19:36.958025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] PATH_INFO: `/v3/projects/ae3d922dc2a8438ca597fd09e925639a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:19:36.959345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3d922dc2a8438ca597fd09e925639a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:19:36.961336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:19:37.000882 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:37.013452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3d922dc2a8438ca597fd09e925639a', 'request_id': 'req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:37.019527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3d922dc2a8438ca597fd09e925639a', 'request_id': 'req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:37.026972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3d922dc2a8438ca597fd09e925639a', 'request_id': 'req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:37.040041 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] The token cache is being invalidate because project ae3d922dc2a8438ca597fd09e925639a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:19:37.040591 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:37.040880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:19:37.042775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1304/2587] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:19:36 2022] DELETE /identity/v3/projects/ae3d922dc2a8438ca597fd09e925639a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:19:46.876381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=6 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:19:47.036836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:20:35.187241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:35.188648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:35.199969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd01db7-dddb-4877-95af-dd7054ef82d3 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:35.250719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:35.251400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:35.251710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:35.251989 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:35.253913 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:35.316065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:35.318059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:35.327757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1284/2588] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:20:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:20:38.407635 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:38.409196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:38.422733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aed29d-6af4-46fe-8f43-f3f5e075a50d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:38.428275 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:38.429161 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:38.429447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:38.429732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] PATH_INFO: `/v3/users/8e15218966314337ae4d70e374bd4bbe` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:38.430972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e15218966314337ae4d70e374bd4bbe)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:38.433017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:38.483323 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e15218966314337ae4d70e374bd4bbe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.491191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e15218966314337ae4d70e374bd4bbe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.491947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e15218966314337ae4d70e374bd4bbe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.505532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e15218966314337ae4d70e374bd4bbe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.506259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-539f2e3c-9e56-44b2-bd9f-6e68a8784fbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e15218966314337ae4d70e374bd4bbe'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.520000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1305/2589] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:20:38 2022] DELETE /identity/v3/users/8e15218966314337ae4d70e374bd4bbe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:20:38.712707 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:38.722833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3f66b0-0339-4a38-ab97-9755fe95695f service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:38.783376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:38.784240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:38.784526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:38.784804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] PATH_INFO: `/v3/projects/f0b22885026a421ea8be652d9f39aa6a` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:38.785969 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b22885026a421ea8be652d9f39aa6a)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:38.787919 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:38.833884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b22885026a421ea8be652d9f39aa6a', 'request_id': 'req-9098090d-0b0d-42bb-8aa1-8db683320253'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.836281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:20:38.841258 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b22885026a421ea8be652d9f39aa6a', 'request_id': 'req-9098090d-0b0d-42bb-8aa1-8db683320253'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.847821 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b22885026a421ea8be652d9f39aa6a', 'request_id': 'req-9098090d-0b0d-42bb-8aa1-8db683320253'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.858571 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] The token cache is being invalidate because project f0b22885026a421ea8be652d9f39aa6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:20:38.858894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.859524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-9098090d-0b0d-42bb-8aa1-8db683320253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:20:38.861150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1285/2590] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:20:38 2022] DELETE /identity/v3/projects/f0b22885026a421ea8be652d9f39aa6a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:20:38.866656 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f981-5cd4-4158-8ac3-3a7c0526d8c9 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:38.866987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f981-5cd4-4158-8ac3-3a7c0526d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:38.867268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4126f981-5cd4-4158-8ac3-3a7c0526d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:38.885049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-4126f981-5cd4-4158-8ac3-3a7c0526d8c9 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:20:38.886246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4126f981-5cd4-4158-8ac3-3a7c0526d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:38.944429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1306/2591] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:20:38.952243 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866fd37-3802-4e33-ac77-903d73fcb11a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:38.952530 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866fd37-3802-4e33-ac77-903d73fcb11a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:38.952806 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866fd37-3802-4e33-ac77-903d73fcb11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:38.971814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6866fd37-3802-4e33-ac77-903d73fcb11a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:20:38.972999 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6866fd37-3802-4e33-ac77-903d73fcb11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:38.980846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1286/2592] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:20:38.985033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f981-5cd4-4158-8ac3-3a7c0526d8c9 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:38.995445 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4126f981-5cd4-4158-8ac3-3a7c0526d8c9 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:38.999978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:39.000652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.000934 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.001205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.001942 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:20:39.002243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:39.003865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:39.016624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1307/2593] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:20:39.021114 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866fd37-3802-4e33-ac77-903d73fcb11a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:39.031991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866fd37-3802-4e33-ac77-903d73fcb11a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:39.038628 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:39.039327 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.039615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.039902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.040611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:39.042550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:39.068835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1287/2594] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:20:39 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:20:39.072949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:39.083972 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455e735-2e51-44ea-a101-bb6060b1ee12 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:39.139847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:39.140507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.140788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.141061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.141732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:39.143658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:39.150662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:20:39.164511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1308/2595] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:20:39 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:20:39.168625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:39.179052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6119f52c-047c-4ced-a178-796208d9f42f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:39.183654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:39.184306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.184589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.184866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.185594 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:39.187213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:39.198121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1288/2596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:20:39.202136 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:39.212688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105b84-5917-48a3-a1db-85a303eb8883 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:39.217336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731857ca-ec18-4862-9a9d-cfdea677868c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:39.217982 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731857ca-ec18-4862-9a9d-cfdea677868c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.218266 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731857ca-ec18-4862-9a9d-cfdea677868c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.218539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731857ca-ec18-4862-9a9d-cfdea677868c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.219307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731857ca-ec18-4862-9a9d-cfdea677868c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:39.220885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731857ca-ec18-4862-9a9d-cfdea677868c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:39.230696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1309/2597] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:20:39.234557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:39.244225 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d3985-be13-4141-a8f0-d99d85b4255c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:39.249004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:39.249862 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.250147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.250417 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] PATH_INFO: `/v3/projects/63ecce0d967f4b44979211260933d760/users/a8c886f340524f81a7bb8223269ae8b7/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.265581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63ecce0d967f4b44979211260933d760, user_id=a8c886f340524f81a7bb8223269ae8b7, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:39.268246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:39.281551 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1289/2598] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:20:39 2022] PUT /identity/v3/projects/63ecce0d967f4b44979211260933d760/users/a8c886f340524f81a7bb8223269ae8b7/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:20:39.286709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1965a-4a12-416a-a40d-998431e7778a None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.287038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1965a-4a12-416a-a40d-998431e7778a None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.287322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1965a-4a12-416a-a40d-998431e7778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.305160 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-61f1965a-4a12-416a-a40d-998431e7778a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:20:39.306364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-61f1965a-4a12-416a-a40d-998431e7778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:39.365763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1310/2599] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:20:39.375560 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:39.377298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:39.434331 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec08495-456d-42ed-8892-07972f5475c3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:39.438003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:39.438648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:39.438974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:39.439256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:39.448732 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:39.450164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:39.460230 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1290/2600] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:20:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:20:43.448668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46412f30-8ec3-4fa4-af59-d82f454d20bc None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:43.449122 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46412f30-8ec3-4fa4-af59-d82f454d20bc None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:43.449215 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46412f30-8ec3-4fa4-af59-d82f454d20bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:43.484005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-46412f30-8ec3-4fa4-af59-d82f454d20bc None None] MFA Rules not processed for user `a8c886f340524f81a7bb8223269ae8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:20:43.485221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-46412f30-8ec3-4fa4-af59-d82f454d20bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:43.555916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1311/2601] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:20:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:20:43.570663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:43.572157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:43.675502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb6931f-0fd3-4b6e-9bf0-a2db47afeeb6 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:43.685340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933c07e-614d-42fa-8eac-4f73f2e698dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:43.686005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933c07e-614d-42fa-8eac-4f73f2e698dc service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:43.686286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933c07e-614d-42fa-8eac-4f73f2e698dc service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:43.686561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933c07e-614d-42fa-8eac-4f73f2e698dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:43.700515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933c07e-614d-42fa-8eac-4f73f2e698dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:43.702184 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933c07e-614d-42fa-8eac-4f73f2e698dc service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:43.711605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1291/2602] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:20:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:20:45.208476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:45.209018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:45.209114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:45.228203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] MFA Rules not processed for user `a8c886f340524f81a7bb8223269ae8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:20:45.229379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:45.236431 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1312/2603] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:20:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:20:53.707916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:20:55.221789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:20:58.118809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:58.119344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:58.119535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:58.138665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:20:58.139945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:58.200480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1292/2604] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:20:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:20:58.252135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:20:58.253600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:20:58.329552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f74f0-9db2-4f57-bd92-ff3ab0013640 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:20:58.334424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f04a87-a66c-40a5-b3cc-4ccd5ccafbc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:20:58.335108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04a87-a66c-40a5-b3cc-4ccd5ccafbc6 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:20:58.335390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04a87-a66c-40a5-b3cc-4ccd5ccafbc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:20:58.335662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f04a87-a66c-40a5-b3cc-4ccd5ccafbc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:20:58.344103 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f04a87-a66c-40a5-b3cc-4ccd5ccafbc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:20:58.345698 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f04a87-a66c-40a5-b3cc-4ccd5ccafbc6 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:20:58.355524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1313/2605] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:20:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:21:01.694183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:01.695626 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:01.822508 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e903d-2d37-4fbb-8c23-f29ee6d9cd70 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:01.831727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e95aa8-b4fd-4b67-acb4-e696e04c715f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:01.832440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95aa8-b4fd-4b67-acb4-e696e04c715f service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:01.832731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95aa8-b4fd-4b67-acb4-e696e04c715f service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:01.833015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e95aa8-b4fd-4b67-acb4-e696e04c715f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:01.835093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-e7e95aa8-b4fd-4b67-acb4-e696e04c715f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:01.850651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e95aa8-b4fd-4b67-acb4-e696e04c715f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:01.852493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e95aa8-b4fd-4b67-acb4-e696e04c715f service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:01.869615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1293/2606] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:21:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:21:08.351322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=32 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:11.858699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=57 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:11.996110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5720c2-fc7d-49b3-bc8f-115f75cfaf81 None None] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:11.996611 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5720c2-fc7d-49b3-bc8f-115f75cfaf81 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:11.996726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5720c2-fc7d-49b3-bc8f-115f75cfaf81 None None] PATH_INFO: `/` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:11.998069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1314/2607] 10.222.0.48 () {54 vars in 921 bytes} [Thu May 26 20:21:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 20:21:12.003360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d03a-767b-4f4e-9659-1ef966bdbc5a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:12.003656 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d03a-767b-4f4e-9659-1ef966bdbc5a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:12.003938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803d03a-767b-4f4e-9659-1ef966bdbc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:12.029790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5803d03a-767b-4f4e-9659-1ef966bdbc5a None None] MFA Rules not processed for user `e8a59979309a45f98c0b4fb27af83c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:21:12.031069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5803d03a-767b-4f4e-9659-1ef966bdbc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:12.041473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1294/2608] 10.222.0.48 () {58 vars in 1018 bytes} [Thu May 26 20:21:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:21:12.053672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5720c2-fc7d-49b3-bc8f-115f75cfaf81 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:12.055400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dd5720c2-fc7d-49b3-bc8f-115f75cfaf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:12.114897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5720c2-fc7d-49b3-bc8f-115f75cfaf81 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:12.118655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8376ffaa09e2496a80fa60c979769d8b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:12.119419 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:12.119705 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:12.119980 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:12.130760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:12.132229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:12.142968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1315/2609] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:21:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:21:14.074033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79ae2-46f9-4d76-b1a8-d4c638de2d72 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:14.074489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79ae2-46f9-4d76-b1a8-d4c638de2d72 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:14.074600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f79ae2-46f9-4d76-b1a8-d4c638de2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:14.092884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c1f79ae2-46f9-4d76-b1a8-d4c638de2d72 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:21:14.094082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c1f79ae2-46f9-4d76-b1a8-d4c638de2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:14.101323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1295/2610] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:21:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:21:14.112989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:14.124527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422df0c0-de9c-47cf-b009-d4b79cf8776a service glance] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:14.129444 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff096bb-3c8f-4ae2-9955-3877b84e65a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:14.130072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff096bb-3c8f-4ae2-9955-3877b84e65a5 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:14.130964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff096bb-3c8f-4ae2-9955-3877b84e65a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:14.131243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff096bb-3c8f-4ae2-9955-3877b84e65a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:14.139171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff096bb-3c8f-4ae2-9955-3877b84e65a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:14.140732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff096bb-3c8f-4ae2-9955-3877b84e65a5 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:14.148599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1316/2611] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:21:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:21:24.087042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=6 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:24.145399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=32 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:29.417776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79ae2-46f9-4d76-b1a8-d4c638de2d72 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:29.427480 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f79ae2-46f9-4d76-b1a8-d4c638de2d72 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:29.431111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:29.431759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:29.432045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:29.432321 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:29.434104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:29.504836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:29.506268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:29.516015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1296/2612] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:21:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:21:31.688289 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fb5f-e26e-41be-bbc1-f409c709e98d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:31.689203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fb5f-e26e-41be-bbc1-f409c709e98d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:31.689683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7fb5f-e26e-41be-bbc1-f409c709e98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:31.708788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6bf7fb5f-e26e-41be-bbc1-f409c709e98d None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:21:31.709996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6bf7fb5f-e26e-41be-bbc1-f409c709e98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:31.717108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1317/2613] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 20:21:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:21:31.729217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:31.741053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bda1a-affe-43e4-9f06-18464a62cd81 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:31.745996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:31.756485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:31.756779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:31.757097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:31.768037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:31.770504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:31.780597 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1297/2614] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:21:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:21:34.289232 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fb5f-e26e-41be-bbc1-f409c709e98d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:34.298559 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7fb5f-e26e-41be-bbc1-f409c709e98d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:34.303288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:34.303941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:34.304229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:34.304509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:34.306287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:34.318325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:34.319796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:34.329369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1318/2615] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:21:40.335986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:40.337939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:40.352043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bcd7bd-46c4-4156-ab20-b7af852ce95c service swift] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:40.356521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:40.357383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:40.357666 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:40.357945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] PATH_INFO: `/v3/users/37020900c19b4887b2b0628af754d388` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:40.359145 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] RBAC: Authorizing `identity:delete_user(user_id=37020900c19b4887b2b0628af754d388)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:40.361055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:40.406536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37020900c19b4887b2b0628af754d388'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.407206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37020900c19b4887b2b0628af754d388'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.407856 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37020900c19b4887b2b0628af754d388'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.415231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37020900c19b4887b2b0628af754d388'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.427188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37020900c19b4887b2b0628af754d388'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.440127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1298/2616] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:21:40 2022] DELETE /identity/v3/users/37020900c19b4887b2b0628af754d388 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:21:40.612820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:40.622943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4c628-03cf-403d-a0a2-b72ece6806fc service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:40.682221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:40.683331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:40.683614 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:40.683886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] PATH_INFO: `/v3/projects/2959aa6f558f4e9b93b4e9aed3aa5f1a` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:40.685143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2959aa6f558f4e9b93b4e9aed3aa5f1a)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:40.687138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:40.736278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2959aa6f558f4e9b93b4e9aed3aa5f1a', 'request_id': 'req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.741633 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2959aa6f558f4e9b93b4e9aed3aa5f1a', 'request_id': 'req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.747623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2959aa6f558f4e9b93b4e9aed3aa5f1a', 'request_id': 'req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.759823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] The token cache is being invalidate because project 2959aa6f558f4e9b93b4e9aed3aa5f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:21:40.760242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.760707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.762265 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1319/2617] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:21:40 2022] DELETE /identity/v3/projects/2959aa6f558f4e9b93b4e9aed3aa5f1a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:21:40.766376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:40.767832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:40.781615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef3f3b-5286-4db1-9fc9-f849ab45beee admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:40.832337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:40.838875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:40.840534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:40.841107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:40.841651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] PATH_INFO: `/v3/users/b610bd9801fa44d8a564273bff504683` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:40.843078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b610bd9801fa44d8a564273bff504683)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:40.845202 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:40.903295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b610bd9801fa44d8a564273bff504683'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.903960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b610bd9801fa44d8a564273bff504683'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.904573 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b610bd9801fa44d8a564273bff504683'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.911440 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b610bd9801fa44d8a564273bff504683'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.923234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c7a4a5f4-e07c-46ac-ba4f-c91a5099dd5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b610bd9801fa44d8a564273bff504683'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:40.936106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1299/2618] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:21:40 2022] DELETE /identity/v3/users/b610bd9801fa44d8a564273bff504683 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:21:41.104962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:21:41.106475 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:21:41.120507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1101b6-45e1-4bc6-a7a6-46edd64cf287 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:21:41.179382 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:21:41.180191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:21:41.180484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:21:41.180802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] PATH_INFO: `/v3/projects/f4231f03b0864f2ea4ca492b949e5e00` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:21:41.182067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4231f03b0864f2ea4ca492b949e5e00)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:21:41.184027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:21:41.199632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:41.237254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4231f03b0864f2ea4ca492b949e5e00', 'request_id': 'req-1ff2b134-9488-4c91-a73b-f294439cba26'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:41.242667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4231f03b0864f2ea4ca492b949e5e00', 'request_id': 'req-1ff2b134-9488-4c91-a73b-f294439cba26'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:41.248778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4231f03b0864f2ea4ca492b949e5e00', 'request_id': 'req-1ff2b134-9488-4c91-a73b-f294439cba26'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:41.261564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] The token cache is being invalidate because project f4231f03b0864f2ea4ca492b949e5e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:21:41.261849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:41.262492 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-1ff2b134-9488-4c91-a73b-f294439cba26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:21:41.264054 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1320/2619] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:21:41 2022] DELETE /identity/v3/projects/f4231f03b0864f2ea4ca492b949e5e00 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:21:50.932687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:21:51.258571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:22:18.842384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:22:18.842936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:22:18.843044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:22:18.860868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] MFA Rules not processed for user `a8c886f340524f81a7bb8223269ae8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:22:18.862096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:22:18.916457 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1300/2620] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:22:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:22:28.909811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=25 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:22:37.477945 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:22:37.480223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:22:37.480510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:22:37.499138 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] MFA Rules not processed for user `7972412da00a4efe9df95922ebe1ef4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:22:37.500324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:22:37.553962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1321/2621] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:22:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:22:47.547174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=25 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:23:46.432171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:23:46.433561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:46.489533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee99bb-d8c6-4e50-9ca5-22c39f6a0a59 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:23:46.493072 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:23:46.493714 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:23:46.494001 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:23:46.494274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:23:46.496030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:46.565569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:23:46.567026 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:23:46.577699 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1301/2622] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:23:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:23:47.975648 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:23:47.977079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:48.032836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187c8c8-4723-4360-9b8f-71946e2fe27b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:23:48.036336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73078f24-ee33-42bc-80de-b2764c7c98ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:23:48.036985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73078f24-ee33-42bc-80de-b2764c7c98ef service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:23:48.037267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73078f24-ee33-42bc-80de-b2764c7c98ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:23:48.037544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73078f24-ee33-42bc-80de-b2764c7c98ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:23:48.039328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-73078f24-ee33-42bc-80de-b2764c7c98ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:48.053148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73078f24-ee33-42bc-80de-b2764c7c98ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:23:48.054567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73078f24-ee33-42bc-80de-b2764c7c98ef service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:23:48.066078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1322/2623] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:23:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:23:49.101754 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:23:49.104281 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:49.119177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6804c7c-1d46-4283-8d0f-0330635fd606 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:23:49.126633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:23:49.127338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:23:49.127620 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:23:49.127891 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:23:49.129894 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:49.143875 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:23:49.145471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:23:49.169690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1302/2624] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:23:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:23:57.775613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:23:57.776159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:23:57.776159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:23:57.794253 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] MFA Rules not processed for user `a8c886f340524f81a7bb8223269ae8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:23:57.795480 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:57.802615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1323/2625] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:23:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:23:58.418020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:23:58.419637 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:58.492826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dee85-841a-4993-afc5-25e3506518ea service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:23:58.497787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:23:58.498433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:23:58.498718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:23:58.499033 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:23:58.501410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:23:58.512561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:23:58.514122 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:23:58.523845 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1303/2626] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:23:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:24:00.350684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:00.352211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:00.366429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cc548-07cc-4efb-a6d7-663f535c2397 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:00.370359 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:00.371046 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:00.371334 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:00.371612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:00.373426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:00.384181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:00.388883 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:00.397823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1324/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:24:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:24:06.442605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:06.453547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca15290-09a1-411e-b3e2-3103d805ae7b service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:06.458071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:06.458888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:06.459367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:06.459654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:06.461909 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:06.474500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:06.476003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:06.487205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1304/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:24:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:24:06.675385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:06.691899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b03ea-26ac-444e-bd9e-f41156405180 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:06.698080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee66235-a5d6-4acc-a593-b7f5da149ec8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:06.698830 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66235-a5d6-4acc-a593-b7f5da149ec8 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:06.699379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66235-a5d6-4acc-a593-b7f5da149ec8 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:06.699775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee66235-a5d6-4acc-a593-b7f5da149ec8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:06.701864 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fee66235-a5d6-4acc-a593-b7f5da149ec8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:06.718024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee66235-a5d6-4acc-a593-b7f5da149ec8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:06.721853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee66235-a5d6-4acc-a593-b7f5da149ec8 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:06.733730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1325/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:24:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:24:10.272399 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:10.278783 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:10.286477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a1088-0831-4401-a80e-cbe27595c162 service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:10.292181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:10.292830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:10.293115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:10.293392 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:10.295210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:10.307877 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:10.309463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:10.320567 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1305/2630] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:24:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:24:16.729188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=41 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:20.315837 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:23.591527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022223a8-9169-4ec8-9634-ce1c00fc9e2f None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:23.592059 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022223a8-9169-4ec8-9634-ce1c00fc9e2f None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:23.592173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022223a8-9169-4ec8-9634-ce1c00fc9e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:23.610117 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-022223a8-9169-4ec8-9634-ce1c00fc9e2f None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:24:23.611364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-022223a8-9169-4ec8-9634-ce1c00fc9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:23.667765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1326/2631] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:24:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:24:23.713722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:23.715157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:23.783719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84307c0d-2618-4347-9c17-0fa29e22c3ba service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:23.789302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33bb1e-37ac-422d-814d-b26acb16b6ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:23.789944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33bb1e-37ac-422d-814d-b26acb16b6ef service swift] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:23.790240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33bb1e-37ac-422d-814d-b26acb16b6ef service swift] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:23.790507 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33bb1e-37ac-422d-814d-b26acb16b6ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:23.798634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33bb1e-37ac-422d-814d-b26acb16b6ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:23.800235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33bb1e-37ac-422d-814d-b26acb16b6ef service swift] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:23.808320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1306/2632] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:24:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:24:33.660530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=25 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:33.804900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=32 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:36.847664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022223a8-9169-4ec8-9634-ce1c00fc9e2f None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:36.858619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022223a8-9169-4ec8-9634-ce1c00fc9e2f None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:36.862756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:36.863636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:36.864022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:36.864425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:36.866932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:36.877693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:36.879181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:36.887258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1327/2633] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:24:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:24:38.423576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9c1e-1583-4b2b-af6b-4f1651b7a851 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:38.424047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9c1e-1583-4b2b-af6b-4f1651b7a851 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:38.424174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e9c1e-1583-4b2b-af6b-4f1651b7a851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:38.441430 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-c31e9c1e-1583-4b2b-af6b-4f1651b7a851 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:24:38.443157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c31e9c1e-1583-4b2b-af6b-4f1651b7a851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:38.450248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1307/2634] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:24:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:24:38.462366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:38.474754 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976cee7-7d07-4937-8e54-d1336c91e26b service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:38.479781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:38.480424 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:38.480711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:38.480988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:38.488990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:38.490557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:38.498623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1328/2635] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 20:24:48.436604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:48.495335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=12 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:24:58.724311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ffda-6459-497e-9d79-cd73f3be7bf2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:58.724798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ffda-6459-497e-9d79-cd73f3be7bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:58.724910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6ffda-6459-497e-9d79-cd73f3be7bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:58.742809 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5cc6ffda-6459-497e-9d79-cd73f3be7bf2 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:24:58.744039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5cc6ffda-6459-497e-9d79-cd73f3be7bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:24:58.767257 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1308/2636] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 20:24:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:24:58.779679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:24:58.796863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c25106-1749-4523-b531-d4a31e709943 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:24:58.802341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:24:58.803049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:24:58.803336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:24:58.803616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:24:58.811692 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:24:58.813274 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:24:58.821335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1329/2637] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:24:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 20:25:08.761920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=10 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:08.817976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=9 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:38.844078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff51fd-c871-4493-87dd-f0aaf4b99380 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:25:38.844633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff51fd-c871-4493-87dd-f0aaf4b99380 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:25:38.844633 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ff51fd-c871-4493-87dd-f0aaf4b99380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:25:38.872638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-39ff51fd-c871-4493-87dd-f0aaf4b99380 None None] MFA Rules not processed for user `a8c886f340524f81a7bb8223269ae8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:25:38.874429 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-39ff51fd-c871-4493-87dd-f0aaf4b99380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:25:38.898514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1309/2638] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:25:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:25:39.202039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:25:39.224823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324b503-af81-49d1-bd73-ab652c5d5a49 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:25:39.228306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:25:39.228937 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:25:39.229217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:25:39.229491 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:25:39.231237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:25:39.252951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:25:39.254355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:25:39.263331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1330/2639] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:25:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:25:42.940791 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff51fd-c871-4493-87dd-f0aaf4b99380 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:25:42.978290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ff51fd-c871-4493-87dd-f0aaf4b99380 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:25:42.983933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:25:42.984579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:25:42.984870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:25:42.985154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:25:42.986947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:25:42.997576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:25:42.999168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:25:43.007817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1310/2640] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:25:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:25:49.258590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=17 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:25:53.003908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=31 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:02.698773 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:02.709135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003495b-970f-4b3b-9026-293fcb7725e1 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:02.714267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:02.715905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:02.716199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:02.716717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:02.718912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:02.806780 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:02.808236 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:02.832568 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1331/2641] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:05.639387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:05.641376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:05.684068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705cb76-b08c-4579-b7eb-c4b547500924 service nova] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:05.690092 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:05.692517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:05.692981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:05.693260 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:05.695175 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:05.709028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:05.710561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:05.712279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:05.713945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:05.726069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af114b1-2024-4db3-a2df-db99b4ff2401 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:05.727279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1311/2642] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:05.745545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:05.748128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:05.749758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:05.750657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] PATH_INFO: `/v3/users/7972412da00a4efe9df95922ebe1ef4e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:05.753087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7972412da00a4efe9df95922ebe1ef4e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:05.755501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:05.826044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7972412da00a4efe9df95922ebe1ef4e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:05.834398 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7972412da00a4efe9df95922ebe1ef4e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:05.835195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7972412da00a4efe9df95922ebe1ef4e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:05.847315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7972412da00a4efe9df95922ebe1ef4e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:05.847987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7972412da00a4efe9df95922ebe1ef4e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:05.861243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1332/2643] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:05 2022] DELETE /identity/v3/users/7972412da00a4efe9df95922ebe1ef4e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:06.038524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.050423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5b376-db2b-4cb0-8af0-455f1920b84c service placement] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.109295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.110360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.110642 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.110954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] PATH_INFO: `/v3/projects/9e673ed28df546b28e1dcd82509bb012` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.112170 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e673ed28df546b28e1dcd82509bb012)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.114067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.163764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.163910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e673ed28df546b28e1dcd82509bb012', 'request_id': 'req-6d5e2790-18e3-4714-9092-af9673488968'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:06.165378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:06.171817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e673ed28df546b28e1dcd82509bb012', 'request_id': 'req-6d5e2790-18e3-4714-9092-af9673488968'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:06.178639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e673ed28df546b28e1dcd82509bb012', 'request_id': 'req-6d5e2790-18e3-4714-9092-af9673488968'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:06.191045 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] The token cache is being invalidate because project 9e673ed28df546b28e1dcd82509bb012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:06.191329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:06.191959 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-6d5e2790-18e3-4714-9092-af9673488968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:06.193494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1312/2644] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:06 2022] DELETE /identity/v3/projects/9e673ed28df546b28e1dcd82509bb012 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:06.198153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b4ca-7c66-4e5b-a010-dee81452bd45 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.198445 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b4ca-7c66-4e5b-a010-dee81452bd45 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.198724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56b4ca-7c66-4e5b-a010-dee81452bd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.210230 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:06.241034 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fdf5b-5e3c-4ce2-ab51-66f5ed14c75b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.257198 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ea56b4ca-7c66-4e5b-a010-dee81452bd45 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:06.258422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ea56b4ca-7c66-4e5b-a010-dee81452bd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:06.279148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:06.300853 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.301638 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.301923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.302197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.304016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:06.315279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.316863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.319433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1313/2645] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:26:06.327416 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1333/2646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:26:06.327804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed676e-4dea-4322-a0a0-139be2b97ff6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.328100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed676e-4dea-4322-a0a0-139be2b97ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.328381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed676e-4dea-4322-a0a0-139be2b97ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.350534 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-00ed676e-4dea-4322-a0a0-139be2b97ff6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:06.351787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-00ed676e-4dea-4322-a0a0-139be2b97ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:06.360967 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1314/2647] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:26:06.365345 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.376254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81200ac8-864c-413f-8889-bdd36568547e service placement] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.381328 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.381993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.382276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.382552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.383321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:26:06.383627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.385206 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.396956 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1334/2648] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:26:06.401252 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed676e-4dea-4322-a0a0-139be2b97ff6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.410868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed676e-4dea-4322-a0a0-139be2b97ff6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.415490 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.416141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.416422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.416724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.417415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.420005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.444596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1315/2649] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:06 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:26:06.448663 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.462224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b8930-cfa7-4fe4-8b83-20c199e580a6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.520280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.520877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.521162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.521441 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.522119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.524079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.544690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1335/2650] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:06 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:06.549263 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.559523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a59bdc-e11e-4761-b625-2bdf23373970 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.564128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.564813 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.565104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.565384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.566117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.567740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.578000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1316/2651] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:06.581813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.592080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cb683-0504-4bd0-b09e-ef2be041910c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.597740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c016209-70f1-43dc-b096-695640d80f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.598418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016209-70f1-43dc-b096-695640d80f15 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.598704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016209-70f1-43dc-b096-695640d80f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.599051 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c016209-70f1-43dc-b096-695640d80f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.599911 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c016209-70f1-43dc-b096-695640d80f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.601508 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c016209-70f1-43dc-b096-695640d80f15 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.612984 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1336/2652] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:06.617020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.627277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf1758-ae21-443e-92bc-4a96b252c1c5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.632778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.633664 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.633952 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.634231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] PATH_INFO: `/v3/projects/281952b3858d49248e0d5aa0480c53a8/users/4e04957b55e14c27ba775a791352b0fb/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.649613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=281952b3858d49248e0d5aa0480c53a8, user_id=4e04957b55e14c27ba775a791352b0fb, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.652303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.665314 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1317/2653] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:06 2022] PUT /identity/v3/projects/281952b3858d49248e0d5aa0480c53a8/users/4e04957b55e14c27ba775a791352b0fb/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:26:06.675537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06cdc2-40b3-4f8e-bedd-2fb7c1de3efe None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.675828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06cdc2-40b3-4f8e-bedd-2fb7c1de3efe None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.676105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06cdc2-40b3-4f8e-bedd-2fb7c1de3efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.702228 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-1d06cdc2-40b3-4f8e-bedd-2fb7c1de3efe None None] MFA Rules not processed for user `4e04957b55e14c27ba775a791352b0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:06.703457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-1d06cdc2-40b3-4f8e-bedd-2fb7c1de3efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:06.727048 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:06.767719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1337/2654] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:26:06.772126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.833587 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06790df-adbf-4dc5-8a5a-5f802bf33527 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.838185 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.838847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.839152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.839434 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.840124 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.842625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.867123 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1318/2655] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:06 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:26:06.871503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06cdc2-40b3-4f8e-bedd-2fb7c1de3efe None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.882124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d06cdc2-40b3-4f8e-bedd-2fb7c1de3efe None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.937251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.937915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.938200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.938479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.939188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.941096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.960435 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1338/2656] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:06 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:06.964386 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:06.975056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b88946-7b1d-4ac6-9cc0-b01a100b7254 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:06.979650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:06.980310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:06.980596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:06.980876 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:06.981605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:06.983232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:06.993836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1319/2657] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:06.998276 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:07.007983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f3a20-38e9-46f0-8335-8b9220a7b1f2 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:07.013108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:07.013970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:07.014250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:07.014524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] PATH_INFO: `/v3/projects/a6f82e89efbd4ca5b2fe519729e82b14/users/fde3c7140e5e4d4ea5625348efae6abd/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:07.028912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f82e89efbd4ca5b2fe519729e82b14, user_id=fde3c7140e5e4d4ea5625348efae6abd, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:07.031544 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:07.044716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1339/2658] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:06 2022] PUT /identity/v3/projects/a6f82e89efbd4ca5b2fe519729e82b14/users/fde3c7140e5e4d4ea5625348efae6abd/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:07.048831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:07.058815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4c717e-7d57-4627-9554-88c70412b3e5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:07.092036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:07.116332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b2fcf-812a-4d1b-9fb5-b0e614ca95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:07.117003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2fcf-812a-4d1b-9fb5-b0e614ca95ab admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:07.117322 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2fcf-812a-4d1b-9fb5-b0e614ca95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:07.117601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b2fcf-812a-4d1b-9fb5-b0e614ca95ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:07.118360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2fcf-812a-4d1b-9fb5-b0e614ca95ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:07.120013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b2fcf-812a-4d1b-9fb5-b0e614ca95ab admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:07.130236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1320/2659] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:07.134258 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:07.144912 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba713781-9e32-46bc-b865-813a3828c08c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:07.149860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:07.150740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:07.151477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:07.151764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] PATH_INFO: `/v3/projects/a6f82e89efbd4ca5b2fe519729e82b14/users/fde3c7140e5e4d4ea5625348efae6abd/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:07.153747 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f82e89efbd4ca5b2fe519729e82b14, user_id=fde3c7140e5e4d4ea5625348efae6abd, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:07.156569 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:07.167197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1340/2660] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:07 2022] PUT /identity/v3/projects/a6f82e89efbd4ca5b2fe519729e82b14/users/fde3c7140e5e4d4ea5625348efae6abd/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:26:07.178643 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d4e9-e0e2-4141-b745-fabd088afa84 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:07.179000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d4e9-e0e2-4141-b745-fabd088afa84 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:07.179284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4d4e9-e0e2-4141-b745-fabd088afa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:07.206344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-deb4d4e9-e0e2-4141-b745-fabd088afa84 None None] MFA Rules not processed for user `fde3c7140e5e4d4ea5625348efae6abd`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:07.207607 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-deb4d4e9-e0e2-4141-b745-fabd088afa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:07.273203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1321/2661] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:26:07.284312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:07.285995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:07.364085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f158d-9ba3-417c-bae5-3a594cf986cd admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:07.367804 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:07.368447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:07.368730 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:07.369005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:07.378652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:07.380111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:07.384957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:07.390203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1341/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:07.460419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4d4e9-e0e2-4141-b745-fabd088afa84 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:07.475091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4d4e9-e0e2-4141-b745-fabd088afa84 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:07.479531 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db577463-bbc5-468a-9130-4dd955835bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:07.480295 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577463-bbc5-468a-9130-4dd955835bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:07.484107 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577463-bbc5-468a-9130-4dd955835bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:07.484427 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db577463-bbc5-468a-9130-4dd955835bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:07.542477 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db577463-bbc5-468a-9130-4dd955835bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:07.543861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db577463-bbc5-468a-9130-4dd955835bb8 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:07.553890 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1322/2663] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:14.223699 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:14.285968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b4e38-8048-46f9-8b65-40c888532a90 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:14.290464 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:14.291361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:14.291645 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:14.291922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] PATH_INFO: `/v3/users/4e04957b55e14c27ba775a791352b0fb` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:14.293108 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e04957b55e14c27ba775a791352b0fb)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:14.295091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:14.339860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e04957b55e14c27ba775a791352b0fb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.350038 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e04957b55e14c27ba775a791352b0fb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.350665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e04957b55e14c27ba775a791352b0fb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.362567 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e04957b55e14c27ba775a791352b0fb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.363213 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e04957b55e14c27ba775a791352b0fb'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.374951 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1342/2664] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:14 2022] DELETE /identity/v3/users/4e04957b55e14c27ba775a791352b0fb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:14.379472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:14.379950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:14.380058 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:14.398970 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:14.400174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:14.449611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:14.459453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1323/2665] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:14.469622 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:14.471075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:14.531530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7425f-895c-4a61-aebd-a6d618380e6c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:14.535101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:14.535734 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:14.536014 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:14.536287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:14.544978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:14.546381 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:14.555901 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1343/2666] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:14.831749 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:14.833167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:14.846722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d3ec1-0406-4cfe-be31-3ae21f1dbee6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:14.851450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:14.852315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:14.852593 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:14.852866 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] PATH_INFO: `/v3/projects/281952b3858d49248e0d5aa0480c53a8` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:14.854037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] RBAC: Authorizing `identity:delete_project(project_id=281952b3858d49248e0d5aa0480c53a8)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:14.855991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:14.902834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281952b3858d49248e0d5aa0480c53a8', 'request_id': 'req-87fdf9be-a346-436a-8367-7166fef5826e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.911121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281952b3858d49248e0d5aa0480c53a8', 'request_id': 'req-87fdf9be-a346-436a-8367-7166fef5826e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.916939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281952b3858d49248e0d5aa0480c53a8', 'request_id': 'req-87fdf9be-a346-436a-8367-7166fef5826e'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.929344 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] The token cache is being invalidate because project 281952b3858d49248e0d5aa0480c53a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:14.929665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.930529 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:14.932181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1324/2667] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:14 2022] DELETE /identity/v3/projects/281952b3858d49248e0d5aa0480c53a8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:14.936371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:14.946237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513e8ba-463a-43a1-ac4b-4c9de517dd1d service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:14.964505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:15.003239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.004101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.004379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.004652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] PATH_INFO: `/v3/users/fde3c7140e5e4d4ea5625348efae6abd` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.005822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde3c7140e5e4d4ea5625348efae6abd)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.007769 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.052338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde3c7140e5e4d4ea5625348efae6abd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.059582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde3c7140e5e4d4ea5625348efae6abd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.060483 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde3c7140e5e4d4ea5625348efae6abd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.072541 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde3c7140e5e4d4ea5625348efae6abd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.073157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-2f0b1a18-de89-4a6f-bb09-739568391128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde3c7140e5e4d4ea5625348efae6abd'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.085576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1344/2668] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:14 2022] DELETE /identity/v3/users/fde3c7140e5e4d4ea5625348efae6abd => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:15.344876 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:15.346292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:15.363159 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdf9be-a346-436a-8367-7166fef5826e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:15.420724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.421570 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.421857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.422135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] PATH_INFO: `/v3/projects/a6f82e89efbd4ca5b2fe519729e82b14` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.423590 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f82e89efbd4ca5b2fe519729e82b14)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.425521 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.471525 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f82e89efbd4ca5b2fe519729e82b14', 'request_id': 'req-feec66ce-1c95-470e-95e2-e69138b45088'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.478511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f82e89efbd4ca5b2fe519729e82b14', 'request_id': 'req-feec66ce-1c95-470e-95e2-e69138b45088'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.484141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f82e89efbd4ca5b2fe519729e82b14', 'request_id': 'req-feec66ce-1c95-470e-95e2-e69138b45088'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.494899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] The token cache is being invalidate because project a6f82e89efbd4ca5b2fe519729e82b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:15.495191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.495822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-feec66ce-1c95-470e-95e2-e69138b45088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:15.497364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1325/2669] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:15 2022] DELETE /identity/v3/projects/a6f82e89efbd4ca5b2fe519729e82b14 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:15.502664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32be90-b8ec-4c73-be34-550dad75b259 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.503181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32be90-b8ec-4c73-be34-550dad75b259 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.503280 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d32be90-b8ec-4c73-be34-550dad75b259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.521874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-8d32be90-b8ec-4c73-be34-550dad75b259 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:15.523116 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-8d32be90-b8ec-4c73-be34-550dad75b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:15.580885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1345/2670] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:15.588603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c06456-304c-48a9-b84f-1acc5e4f0057 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.588900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c06456-304c-48a9-b84f-1acc5e4f0057 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.589186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c06456-304c-48a9-b84f-1acc5e4f0057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.607944 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-74c06456-304c-48a9-b84f-1acc5e4f0057 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:15.609144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-74c06456-304c-48a9-b84f-1acc5e4f0057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:15.617061 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1326/2671] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:15.621077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32be90-b8ec-4c73-be34-550dad75b259 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:15.631586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d32be90-b8ec-4c73-be34-550dad75b259 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:15.636125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.636784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.637064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.637336 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.638053 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:26:15.638361 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.639979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.651453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1346/2672] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:26:15.655874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c06456-304c-48a9-b84f-1acc5e4f0057 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:15.661458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:15.665348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c06456-304c-48a9-b84f-1acc5e4f0057 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:15.671847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.673089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.673583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.673948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.674690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.676836 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.701779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1327/2673] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:15 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:26:15.705872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:15.716004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3fa85-458e-4f84-b10c-3b68ac0ea3bb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:15.741540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:15.774229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.774915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.775198 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.775470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.776701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.778499 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.798919 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1347/2674] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:15 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:15.803102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:15.814079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58aae5-0ab1-4c2a-b5b7-5a957e5ff6cb admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:15.818792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.819527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.819817 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.820097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.820832 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.822424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.833458 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1328/2675] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:15.837636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:15.847833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce527ca-9561-48f1-870d-4bb5d71fba80 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:15.852525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d93e85-bf72-4d20-87b0-7d6e15b956c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.853210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d93e85-bf72-4d20-87b0-7d6e15b956c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.853493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d93e85-bf72-4d20-87b0-7d6e15b956c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.853767 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d93e85-bf72-4d20-87b0-7d6e15b956c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.854479 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d93e85-bf72-4d20-87b0-7d6e15b956c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.856080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d93e85-bf72-4d20-87b0-7d6e15b956c3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.866244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1348/2676] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:15.870310 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:15.881003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5d00a-ca15-4401-85d3-e158b7b77eda admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:15.885625 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:15.886492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.886774 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.887149 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] PATH_INFO: `/v3/projects/2d28569ca91048ffab4977b8debc7c01/users/cb7d81f091ca41daa1441e0be9c5ff95/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.901378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d28569ca91048ffab4977b8debc7c01, user_id=cb7d81f091ca41daa1441e0be9c5ff95, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:15.904052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:15.916433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1329/2677] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:15 2022] PUT /identity/v3/projects/2d28569ca91048ffab4977b8debc7c01/users/cb7d81f091ca41daa1441e0be9c5ff95/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:15.928637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbbdd1-e48b-4308-99fe-49d355ce5747 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:15.928927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbbdd1-e48b-4308-99fe-49d355ce5747 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:15.929205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbbdd1-e48b-4308-99fe-49d355ce5747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:15.956503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-78fbbdd1-e48b-4308-99fe-49d355ce5747 None None] MFA Rules not processed for user `cb7d81f091ca41daa1441e0be9c5ff95`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:15.957756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-78fbbdd1-e48b-4308-99fe-49d355ce5747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:16.020685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1349/2678] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:16.025128 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:16.085577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500abd8-b75a-4764-9f67-e372cf847d4c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:16.090280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:16.090979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.091764 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.092055 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.092740 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:16.094640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:16.119777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1330/2679] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:16 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:16.123786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbbdd1-e48b-4308-99fe-49d355ce5747 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:16.134318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbbdd1-e48b-4308-99fe-49d355ce5747 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:16.189616 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:16.190284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.190571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.190868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.191565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:16.193476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:16.212005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1350/2680] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:16 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:16.216096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:16.226606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ea5d2-7d1f-4de5-a176-ce2a9ed1428f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:16.231109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:16.231760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.232660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.232936 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.233655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:16.235290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:16.245718 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1331/2681] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:16.249790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:16.259875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82139afe-d67e-4825-9443-57919547acfc admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:16.264507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:16.265388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.265703 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.266005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] PATH_INFO: `/v3/projects/fa2c41ce7a2d421b85e827ad736068aa/users/4086c797c61b4ad0bd8b3bc119b15b52/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.281104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2c41ce7a2d421b85e827ad736068aa, user_id=4086c797c61b4ad0bd8b3bc119b15b52, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:16.283861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:16.296722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1351/2682] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:16 2022] PUT /identity/v3/projects/fa2c41ce7a2d421b85e827ad736068aa/users/4086c797c61b4ad0bd8b3bc119b15b52/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:16.300907 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:16.311034 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ebc28-6ff7-4232-b534-fc0ca91ff130 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:16.368220 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687debc-8be1-4f24-83b7-a06a9172e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:16.368899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687debc-8be1-4f24-83b7-a06a9172e139 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.369188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687debc-8be1-4f24-83b7-a06a9172e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.369471 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687debc-8be1-4f24-83b7-a06a9172e139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.370208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687debc-8be1-4f24-83b7-a06a9172e139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:16.372059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687debc-8be1-4f24-83b7-a06a9172e139 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:16.381867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1332/2683] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:16.386178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:16.392311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:16.398177 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf49ae-f735-4dad-80a2-aa048261d93f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:16.402946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:16.404447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.404731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.405003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] PATH_INFO: `/v3/projects/fa2c41ce7a2d421b85e827ad736068aa/users/4086c797c61b4ad0bd8b3bc119b15b52/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.406968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2c41ce7a2d421b85e827ad736068aa, user_id=4086c797c61b4ad0bd8b3bc119b15b52, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:16.409585 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:16.419501 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1352/2684] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:16 2022] PUT /identity/v3/projects/fa2c41ce7a2d421b85e827ad736068aa/users/4086c797c61b4ad0bd8b3bc119b15b52/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:16.429759 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ead39c-46c7-46ca-8d91-044ef7fb3e65 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.430249 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ead39c-46c7-46ca-8d91-044ef7fb3e65 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.430347 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ead39c-46c7-46ca-8d91-044ef7fb3e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.457191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a6ead39c-46c7-46ca-8d91-044ef7fb3e65 None None] MFA Rules not processed for user `4086c797c61b4ad0bd8b3bc119b15b52`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:16.458432 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a6ead39c-46c7-46ca-8d91-044ef7fb3e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:16.463605 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:16.528140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1333/2685] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:16.539327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:16.541131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:16.599214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0921a0-59bc-475b-8f11-0c9b19196943 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:16.602875 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:16.603521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:16.603808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:16.604086 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:16.661211 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:16.662652 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:16.671489 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1353/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:19.200512 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ead39c-46c7-46ca-8d91-044ef7fb3e65 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:19.210489 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ead39c-46c7-46ca-8d91-044ef7fb3e65 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:19.215051 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfcc8b-6a61-4c38-8535-62406945ceb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:19.215690 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfcc8b-6a61-4c38-8535-62406945ceb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:19.215979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfcc8b-6a61-4c38-8535-62406945ceb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:19.217022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfcc8b-6a61-4c38-8535-62406945ceb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:19.226474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfcc8b-6a61-4c38-8535-62406945ceb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:19.227940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfcc8b-6a61-4c38-8535-62406945ceb1 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:19.237981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1334/2687] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:26.667471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:29.233674 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=32 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:31.596549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:31.660231 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0bdf-bf75-4316-82c5-f362c81deff5 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:31.664719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:31.665582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:31.665865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:31.666142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] PATH_INFO: `/v3/users/cb7d81f091ca41daa1441e0be9c5ff95` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:31.667356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7d81f091ca41daa1441e0be9c5ff95)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:31.669307 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:31.717415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7d81f091ca41daa1441e0be9c5ff95'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:31.724868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7d81f091ca41daa1441e0be9c5ff95'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:31.725477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7d81f091ca41daa1441e0be9c5ff95'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:31.737205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7d81f091ca41daa1441e0be9c5ff95'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:31.737829 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7d81f091ca41daa1441e0be9c5ff95'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:31.750391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1354/2688] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:31 2022] DELETE /identity/v3/users/cb7d81f091ca41daa1441e0be9c5ff95 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:31.754814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:31.755311 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:31.755419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:31.773585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:31.774784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:31.834428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1335/2689] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:31.844465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:31.845872 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:31.903745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b48f2b-9bd8-438a-a816-7bcf654f3246 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:31.907899 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:31.908539 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:31.908823 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:31.909101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:31.917858 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:31.919395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:31.929660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1355/2690] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:32.199798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:32.201223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:32.213065 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6396f-e899-4909-9129-fd71e6e45ed7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:32.218108 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:32.219016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:32.219304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:32.219583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] PATH_INFO: `/v3/projects/2d28569ca91048ffab4977b8debc7c01` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:32.220778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d28569ca91048ffab4977b8debc7c01)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:32.222698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:32.269008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d28569ca91048ffab4977b8debc7c01', 'request_id': 'req-58700a15-a975-4240-9a23-2171885be330'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.275847 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d28569ca91048ffab4977b8debc7c01', 'request_id': 'req-58700a15-a975-4240-9a23-2171885be330'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.281449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d28569ca91048ffab4977b8debc7c01', 'request_id': 'req-58700a15-a975-4240-9a23-2171885be330'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.292209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] The token cache is being invalidate because project 2d28569ca91048ffab4977b8debc7c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:32.292512 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.293139 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.294657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1336/2691] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:32 2022] DELETE /identity/v3/projects/2d28569ca91048ffab4977b8debc7c01 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:32.299440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:32.309002 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100fa59-1183-402e-9fac-7a3108ce2390 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:32.327312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:32.367521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:32.368560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:32.368847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:32.369121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] PATH_INFO: `/v3/users/4086c797c61b4ad0bd8b3bc119b15b52` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:32.370293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4086c797c61b4ad0bd8b3bc119b15b52)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:32.372240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:32.420784 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4086c797c61b4ad0bd8b3bc119b15b52'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.427971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4086c797c61b4ad0bd8b3bc119b15b52'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.428575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4086c797c61b4ad0bd8b3bc119b15b52'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.440688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4086c797c61b4ad0bd8b3bc119b15b52'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.441305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f714fe03-4270-4e28-9708-7ae5375becb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4086c797c61b4ad0bd8b3bc119b15b52'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.453987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1356/2692] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:32 2022] DELETE /identity/v3/users/4086c797c61b4ad0bd8b3bc119b15b52 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:32.717152 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:32.718723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:32.731701 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58700a15-a975-4240-9a23-2171885be330 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:32.788652 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:32.789511 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:32.789797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:32.790078 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] PATH_INFO: `/v3/projects/fa2c41ce7a2d421b85e827ad736068aa` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:32.791296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2c41ce7a2d421b85e827ad736068aa)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:32.793187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:32.823786 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:32.841745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2c41ce7a2d421b85e827ad736068aa', 'request_id': 'req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.849165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2c41ce7a2d421b85e827ad736068aa', 'request_id': 'req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.854668 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2c41ce7a2d421b85e827ad736068aa', 'request_id': 'req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.865770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] The token cache is being invalidate because project fa2c41ce7a2d421b85e827ad736068aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:32.866062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.866709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c9e14ff5-74d7-4488-a92c-7ea2fcb16eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:32.868286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1337/2693] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:32 2022] DELETE /identity/v3/projects/fa2c41ce7a2d421b85e827ad736068aa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:32.873164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e513-f33e-469d-8f96-d09c541a1686 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:32.873666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e513-f33e-469d-8f96-d09c541a1686 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:32.873792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e513-f33e-469d-8f96-d09c541a1686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:32.892449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-9367e513-f33e-469d-8f96-d09c541a1686 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:32.893584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-9367e513-f33e-469d-8f96-d09c541a1686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:32.950453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1357/2694] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:32.959089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc407b5d-5692-4859-a74f-b4d418a17552 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:32.959381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc407b5d-5692-4859-a74f-b4d418a17552 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:32.959682 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc407b5d-5692-4859-a74f-b4d418a17552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:32.978493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bc407b5d-5692-4859-a74f-b4d418a17552 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:32.979757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bc407b5d-5692-4859-a74f-b4d418a17552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:32.987865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1338/2695] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:32.991889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367e513-f33e-469d-8f96-d09c541a1686 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.001451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367e513-f33e-469d-8f96-d09c541a1686 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.005954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.006604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.006915 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.007197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.007922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:26:33.008256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.009843 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.021970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1358/2696] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:26:33.026351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc407b5d-5692-4859-a74f-b4d418a17552 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.036052 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc407b5d-5692-4859-a74f-b4d418a17552 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.040733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.041377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.041704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.042028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.042799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.044899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.070757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1339/2697] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:33 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:33.074931 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.085000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee21faa-0af7-4eda-9abc-625c0c5b5d85 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.111732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:33.145314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.145913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.146203 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.146484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.147214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.149142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.172851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1359/2698] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:33 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:33.176261 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.188667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca03d8-6054-4f15-b7bd-6b8fd75aa4a1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.195083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.195755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.196043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.196323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.197054 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.198657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.209533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1340/2699] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:33.213519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.223869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73119a42-4e0b-49bb-a13e-996bafa5f2bb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.228420 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26adbd40-4e2c-40d9-855a-27d4a77983a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.229079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adbd40-4e2c-40d9-855a-27d4a77983a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.229362 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adbd40-4e2c-40d9-855a-27d4a77983a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.229639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26adbd40-4e2c-40d9-855a-27d4a77983a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.230358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adbd40-4e2c-40d9-855a-27d4a77983a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.232011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26adbd40-4e2c-40d9-855a-27d4a77983a5 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.243173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1360/2700] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:33.247186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.257239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d764558-e6df-4864-88cb-715fdaede581 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.261815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.262694 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.263015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.263293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] PATH_INFO: `/v3/projects/5327a48e0ce8498588aa190040c65ed3/users/7c73c8ff724547a093a7175f2fbde356/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.277513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5327a48e0ce8498588aa190040c65ed3, user_id=7c73c8ff724547a093a7175f2fbde356, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.280226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.293117 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1341/2701] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:33 2022] PUT /identity/v3/projects/5327a48e0ce8498588aa190040c65ed3/users/7c73c8ff724547a093a7175f2fbde356/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:33.305139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd046-381f-4b1c-a305-61cd1cdfd0ce None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.305453 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd046-381f-4b1c-a305-61cd1cdfd0ce None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.305732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfd046-381f-4b1c-a305-61cd1cdfd0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.331437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dcbfd046-381f-4b1c-a305-61cd1cdfd0ce None None] MFA Rules not processed for user `7c73c8ff724547a093a7175f2fbde356`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:33.332636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dcbfd046-381f-4b1c-a305-61cd1cdfd0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:33.396225 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1361/2702] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:33.400725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.462544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ccb1a-fd16-45e6-b5b9-678fbce10968 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.467277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.467932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.468222 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.468504 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.469195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.471113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.495785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1342/2703] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:33 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:33.500418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd046-381f-4b1c-a305-61cd1cdfd0ce None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.510976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfd046-381f-4b1c-a305-61cd1cdfd0ce None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.570146 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.570817 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.571137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.571415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.572107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.574100 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.594101 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1362/2704] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:33 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:33.598113 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.608142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec791e4-cf84-4413-a073-11b8e30e0275 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.613105 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.613757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.614043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.614318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.615142 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.616719 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.627710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1343/2705] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:33.632020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.642015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed933217-0f98-4b8d-aff0-29c2df6c41b9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.646602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.647523 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.647827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.648106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] PATH_INFO: `/v3/projects/3ed86d6a505f4615b2380df91ab90b74/users/05d8aa5e6ce94db18e49017e4fa6f318/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.662379 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed86d6a505f4615b2380df91ab90b74, user_id=05d8aa5e6ce94db18e49017e4fa6f318, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.665050 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.677855 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1363/2706] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:33 2022] PUT /identity/v3/projects/3ed86d6a505f4615b2380df91ab90b74/users/05d8aa5e6ce94db18e49017e4fa6f318/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:33.681776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.692302 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03cc405-1a2a-4b9f-9b64-6f030cfc59ea admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.721667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:33.760768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d155e7f-776a-4656-bd1b-ffe067ec7799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.761439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d155e7f-776a-4656-bd1b-ffe067ec7799 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.761723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d155e7f-776a-4656-bd1b-ffe067ec7799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.762000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d155e7f-776a-4656-bd1b-ffe067ec7799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.762725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d155e7f-776a-4656-bd1b-ffe067ec7799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.764356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d155e7f-776a-4656-bd1b-ffe067ec7799 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.773991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1344/2707] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:33.778358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.783788 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:33.789806 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c82f4f-9859-4c34-a7a7-7c4997cb065f admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:33.794860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:33.795749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.796029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.796836 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] PATH_INFO: `/v3/projects/3ed86d6a505f4615b2380df91ab90b74/users/05d8aa5e6ce94db18e49017e4fa6f318/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.799171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed86d6a505f4615b2380df91ab90b74, user_id=05d8aa5e6ce94db18e49017e4fa6f318, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:33.802142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:33.812762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1364/2708] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:33 2022] PUT /identity/v3/projects/3ed86d6a505f4615b2380df91ab90b74/users/05d8aa5e6ce94db18e49017e4fa6f318/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:33.822810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cd84-7b60-46f8-9981-18eb20939855 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:33.823358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cd84-7b60-46f8-9981-18eb20939855 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:33.823459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cd84-7b60-46f8-9981-18eb20939855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:33.853431 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-bb15cd84-7b60-46f8-9981-18eb20939855 None None] MFA Rules not processed for user `05d8aa5e6ce94db18e49017e4fa6f318`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:33.854934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-bb15cd84-7b60-46f8-9981-18eb20939855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:33.931289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1345/2709] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:33.944227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:33.946347 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:34.013109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6608ab6-cc5b-4d12-849e-d556433ba599 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:34.017297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7633d5-fa5f-4972-9d3c-ab923ef7e414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:34.017940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7633d5-fa5f-4972-9d3c-ab923ef7e414 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:34.018223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7633d5-fa5f-4972-9d3c-ab923ef7e414 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:34.018507 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7633d5-fa5f-4972-9d3c-ab923ef7e414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:34.031344 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7633d5-fa5f-4972-9d3c-ab923ef7e414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:34.032848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7633d5-fa5f-4972-9d3c-ab923ef7e414 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:34.045761 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1365/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:34.075965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15cd84-7b60-46f8-9981-18eb20939855 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:34.137146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15cd84-7b60-46f8-9981-18eb20939855 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:34.141746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:34.142623 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:34.142941 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:34.143226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] PATH_INFO: `/v3/users/7c73c8ff724547a093a7175f2fbde356` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:34.144441 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c73c8ff724547a093a7175f2fbde356)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:34.146379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:34.194067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c73c8ff724547a093a7175f2fbde356'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.194636 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c73c8ff724547a093a7175f2fbde356'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.195338 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c73c8ff724547a093a7175f2fbde356'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.196684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:34.204797 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c73c8ff724547a093a7175f2fbde356'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.220201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c73c8ff724547a093a7175f2fbde356'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.233777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1346/2711] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:34 2022] DELETE /identity/v3/users/7c73c8ff724547a093a7175f2fbde356 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:26:34.239027 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:34.239306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:34.239586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:34.258976 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:34.260272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:34.322997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1366/2712] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:34.333056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:34.334475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:34.396505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bb171-abd6-42b9-8f6f-70c3139d0932 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:34.401088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:34.401743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:34.402030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:34.402305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:34.412102 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:34.413526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:34.424043 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1347/2713] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:26:34.697191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:34.698657 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:34.711566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d5eda-5fb8-435f-a913-ff0ecbbfc26c None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:34.716176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:34.717069 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:34.717348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:34.717620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] PATH_INFO: `/v3/projects/5327a48e0ce8498588aa190040c65ed3` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:34.718809 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5327a48e0ce8498588aa190040c65ed3)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:34.720968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:34.767695 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5327a48e0ce8498588aa190040c65ed3', 'request_id': 'req-d950e979-93b8-4419-ac3b-9f5f417bd7d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.773468 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5327a48e0ce8498588aa190040c65ed3', 'request_id': 'req-d950e979-93b8-4419-ac3b-9f5f417bd7d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.779685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5327a48e0ce8498588aa190040c65ed3', 'request_id': 'req-d950e979-93b8-4419-ac3b-9f5f417bd7d3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.791684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] The token cache is being invalidate because project 5327a48e0ce8498588aa190040c65ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:34.791988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.792610 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.794139 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1367/2714] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:34 2022] DELETE /identity/v3/projects/5327a48e0ce8498588aa190040c65ed3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:34.798638 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:34.808193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219771b5-00f0-4d57-9cf9-ba547f34c65e service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:34.863451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:34.864329 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:34.864613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:34.864888 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] PATH_INFO: `/v3/users/05d8aa5e6ce94db18e49017e4fa6f318` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:34.866068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d8aa5e6ce94db18e49017e4fa6f318)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:34.868036 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:34.920154 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d8aa5e6ce94db18e49017e4fa6f318'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.920805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d8aa5e6ce94db18e49017e4fa6f318'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.921925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d8aa5e6ce94db18e49017e4fa6f318'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.929256 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d8aa5e6ce94db18e49017e4fa6f318'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.940237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:34.942879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2b475e4c-cf93-4bf7-8a38-539bffbbb9fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d8aa5e6ce94db18e49017e4fa6f318'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:34.956615 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1348/2715] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:34 2022] DELETE /identity/v3/users/05d8aa5e6ce94db18e49017e4fa6f318 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:35.226210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.227683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:35.242158 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950e979-93b8-4419-ac3b-9f5f417bd7d3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.255080 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:35.301063 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.301849 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.302128 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.302401 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] PATH_INFO: `/v3/projects/3ed86d6a505f4615b2380df91ab90b74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.303590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed86d6a505f4615b2380df91ab90b74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.305481 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:35.350187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed86d6a505f4615b2380df91ab90b74', 'request_id': 'req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:35.355626 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed86d6a505f4615b2380df91ab90b74', 'request_id': 'req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:35.362124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed86d6a505f4615b2380df91ab90b74', 'request_id': 'req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:35.373450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] The token cache is being invalidate because project 3ed86d6a505f4615b2380df91ab90b74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:35.373737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:35.374997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-55b7fbfb-0e3e-4c04-ad99-9675b5e6407f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:35.376527 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1368/2716] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:35 2022] DELETE /identity/v3/projects/3ed86d6a505f4615b2380df91ab90b74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:35.381519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67cfa5-9266-459d-ad08-8ede46f15222 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.381818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67cfa5-9266-459d-ad08-8ede46f15222 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.382103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67cfa5-9266-459d-ad08-8ede46f15222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.400076 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-5c67cfa5-9266-459d-ad08-8ede46f15222 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:35.401280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-5c67cfa5-9266-459d-ad08-8ede46f15222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:35.459575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1349/2717] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:35.468863 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d148-9b03-488a-a55d-47df3bfd3c82 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.469152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d148-9b03-488a-a55d-47df3bfd3c82 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.469433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296d148-9b03-488a-a55d-47df3bfd3c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.488185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2296d148-9b03-488a-a55d-47df3bfd3c82 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:35.489385 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2296d148-9b03-488a-a55d-47df3bfd3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:35.497163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1369/2718] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:35.501378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67cfa5-9266-459d-ad08-8ede46f15222 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.511042 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67cfa5-9266-459d-ad08-8ede46f15222 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.515596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.516248 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.516533 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.516812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.517561 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:26:35.517870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.519488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:35.531340 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1350/2719] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:26:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:26:35.535455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d148-9b03-488a-a55d-47df3bfd3c82 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.544654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296d148-9b03-488a-a55d-47df3bfd3c82 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.550017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.550661 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.550995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.551329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.551975 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.553839 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:35.580029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1370/2720] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:35 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:35.584001 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.593947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a93415-1f97-4a1e-82e2-ea4122e4355c admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.652991 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.653673 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.653957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.654235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.654942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.656880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:35.676137 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1351/2721] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:35 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:35.680176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.690681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76f339-dac1-4bb2-8db8-2cfcb162bdbb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.695305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.695960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.696242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.696519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.697244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.698988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:35.709678 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1371/2722] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:35.713346 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.723406 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e9ebc3-cddd-4bbd-a9a1-2205d1cd7fc3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.728030 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff16bb-e019-4520-b107-060406b559e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.728692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff16bb-e019-4520-b107-060406b559e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.728979 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff16bb-e019-4520-b107-060406b559e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.729262 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff16bb-e019-4520-b107-060406b559e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.730021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff16bb-e019-4520-b107-060406b559e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.731651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff16bb-e019-4520-b107-060406b559e4 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:35.742153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1352/2723] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:35.746058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.756662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cd150-b8d4-4f77-be5e-9fba8a822282 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.761263 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.762157 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.762460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.762733 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] PATH_INFO: `/v3/projects/24d48939b12b4a5b8bd64df88e5551a5/users/6770dda8ecab4af883a93e3b894aa429/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.777534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d48939b12b4a5b8bd64df88e5551a5, user_id=6770dda8ecab4af883a93e3b894aa429, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.780598 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:35.793194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1372/2724] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:35 2022] PUT /identity/v3/projects/24d48939b12b4a5b8bd64df88e5551a5/users/6770dda8ecab4af883a93e3b894aa429/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:35.804485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b2dd-14fa-4314-8229-bfc4aaffa827 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.804723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b2dd-14fa-4314-8229-bfc4aaffa827 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.805003 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4b2dd-14fa-4314-8229-bfc4aaffa827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.832234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-26f4b2dd-14fa-4314-8229-bfc4aaffa827 None None] MFA Rules not processed for user `6770dda8ecab4af883a93e3b894aa429`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:35.833582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-26f4b2dd-14fa-4314-8229-bfc4aaffa827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:35.876424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:35.901150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1353/2725] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:35.907129 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:35.955399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:35.974081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0455a-9d8c-48ef-8ce4-1f9c2caba9da admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:35.978701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:35.979383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:35.979666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:35.979941 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:35.980630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:35.982525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:36.006395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1373/2726] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:35 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:36.010586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b2dd-14fa-4314-8229-bfc4aaffa827 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:36.021618 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4b2dd-14fa-4314-8229-bfc4aaffa827 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:36.077115 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:36.078269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:36.078553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:36.078829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:36.079581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:36.081741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:36.101439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1354/2727] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:36 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:36.105374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:36.115877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fccb7b-9a34-41e4-957e-bca9994478d9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:36.120458 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:36.121107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:36.121390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:36.121665 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:36.122383 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:36.124004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:36.135803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1374/2728] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:36.139595 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:36.149247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86818f7-1864-4917-b746-06e2e9cefcd6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:36.153810 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:36.154684 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:36.155005 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:36.155286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] PATH_INFO: `/v3/projects/cf74759387604b4baf2703261a0c67f2/users/72114bc28f354b07ad08534e5d387272/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:36.170384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf74759387604b4baf2703261a0c67f2, user_id=72114bc28f354b07ad08534e5d387272, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:36.173963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:36.186191 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1355/2729] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:36 2022] PUT /identity/v3/projects/cf74759387604b4baf2703261a0c67f2/users/72114bc28f354b07ad08534e5d387272/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:26:36.190573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:36.200287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38629376-c391-4e7d-8184-b5982d0a6ddb admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:36.262953 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ad291-21af-4f26-ba79-f5d96a3becad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:36.263666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ad291-21af-4f26-ba79-f5d96a3becad admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:36.263890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ad291-21af-4f26-ba79-f5d96a3becad admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:36.264166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ad291-21af-4f26-ba79-f5d96a3becad admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:36.265521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ad291-21af-4f26-ba79-f5d96a3becad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:36.267142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ad291-21af-4f26-ba79-f5d96a3becad admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:36.277238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1375/2730] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:36.281358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:36.291496 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0523e0-a8a3-4531-84c1-4acfbb8279e1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:36.296063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:36.296981 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:36.297515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:36.297792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] PATH_INFO: `/v3/projects/cf74759387604b4baf2703261a0c67f2/users/72114bc28f354b07ad08534e5d387272/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:36.299784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf74759387604b4baf2703261a0c67f2, user_id=72114bc28f354b07ad08534e5d387272, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:36.302415 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:36.312954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1356/2731] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:36 2022] PUT /identity/v3/projects/cf74759387604b4baf2703261a0c67f2/users/72114bc28f354b07ad08534e5d387272/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:26:36.323039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:36.323329 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:36.323604 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:36.349413 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] MFA Rules not processed for user `72114bc28f354b07ad08534e5d387272`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:36.350595 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:36.418669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1376/2732] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:36.430186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:36.431950 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:36.489785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df48a7-c1ac-4c97-8c57-5f95a58493a8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:36.493384 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:36.494023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:36.494303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:36.494577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:36.540930 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:36.558683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:36.560221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:36.570784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1357/2733] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:37.921714 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:37.923446 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:37.935234 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7559c17-de93-4518-b15f-f6012db31c23 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:37.939257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53360ce-56fd-4ee4-b189-cdfca0526cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:37.939898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53360ce-56fd-4ee4-b189-cdfca0526cec service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:37.940180 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53360ce-56fd-4ee4-b189-cdfca0526cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:37.940456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53360ce-56fd-4ee4-b189-cdfca0526cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:37.949242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53360ce-56fd-4ee4-b189-cdfca0526cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:37.950653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53360ce-56fd-4ee4-b189-cdfca0526cec service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:37.960599 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1377/2734] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:41.679992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:41.741785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84023e7-0497-46f7-a2f3-9d924413ac7e service cinder] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:41.746353 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:41.747268 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:41.747557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:41.747834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] PATH_INFO: `/v3/users/6770dda8ecab4af883a93e3b894aa429` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:41.749021 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6770dda8ecab4af883a93e3b894aa429)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:41.750961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:41.802577 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6770dda8ecab4af883a93e3b894aa429'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:41.803247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6770dda8ecab4af883a93e3b894aa429'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:41.803855 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6770dda8ecab4af883a93e3b894aa429'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:41.810655 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6770dda8ecab4af883a93e3b894aa429'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:41.822319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6770dda8ecab4af883a93e3b894aa429'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:41.836200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1358/2735] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:41 2022] DELETE /identity/v3/users/6770dda8ecab4af883a93e3b894aa429 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:41.840312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:41.840704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:41.840947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:41.858718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:41.859977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:41.878227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:41.920486 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1378/2736] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:41.930286 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:41.931702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:41.988896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb36221-3807-4d1d-92e7-f9668aab749f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:41.992505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:41.993147 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:41.993433 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:41.993712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:42.002514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:42.003975 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:42.013188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1359/2737] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:42.274264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:42.275834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:42.287838 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a43dd-8edb-4751-ac34-b1000548c846 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:42.292577 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:42.293455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:42.293828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:42.294111 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] PATH_INFO: `/v3/projects/24d48939b12b4a5b8bd64df88e5551a5` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:42.295564 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d48939b12b4a5b8bd64df88e5551a5)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:42.297745 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:42.345717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d48939b12b4a5b8bd64df88e5551a5', 'request_id': 'req-cdd9a16b-9743-450b-9f2f-9af535f4098c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.351200 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d48939b12b4a5b8bd64df88e5551a5', 'request_id': 'req-cdd9a16b-9743-450b-9f2f-9af535f4098c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.357216 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d48939b12b4a5b8bd64df88e5551a5', 'request_id': 'req-cdd9a16b-9743-450b-9f2f-9af535f4098c'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.370033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] The token cache is being invalidate because project 24d48939b12b4a5b8bd64df88e5551a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:42.370516 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.371143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.372732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1379/2738] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:42 2022] DELETE /identity/v3/projects/24d48939b12b4a5b8bd64df88e5551a5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:42.377413 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:42.387169 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93a131-3456-4d8a-a72d-c6f3f7e4cddd service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:42.395745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:42.446301 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:42.447204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:42.447493 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:42.447772 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] PATH_INFO: `/v3/users/72114bc28f354b07ad08534e5d387272` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:42.448976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] RBAC: Authorizing `identity:delete_user(user_id=72114bc28f354b07ad08534e5d387272)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:42.450960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:42.498385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72114bc28f354b07ad08534e5d387272'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.499068 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72114bc28f354b07ad08534e5d387272'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.499687 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72114bc28f354b07ad08534e5d387272'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.507419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72114bc28f354b07ad08534e5d387272'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.519630 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-a7c0efd0-117b-4354-a1ee-8532771decca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72114bc28f354b07ad08534e5d387272'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.531790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1360/2739] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:26:42 2022] DELETE /identity/v3/users/72114bc28f354b07ad08534e5d387272 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:42.797994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:42.799575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:42.814628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9a16b-9743-450b-9f2f-9af535f4098c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:42.872432 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:42.873300 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:42.873594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:42.873874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] PATH_INFO: `/v3/projects/cf74759387604b4baf2703261a0c67f2` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:42.875726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf74759387604b4baf2703261a0c67f2)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:42.877650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:42.930977 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf74759387604b4baf2703261a0c67f2', 'request_id': 'req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.932178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:42.943283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf74759387604b4baf2703261a0c67f2', 'request_id': 'req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.952119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf74759387604b4baf2703261a0c67f2', 'request_id': 'req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.964105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] The token cache is being invalidate because project cf74759387604b4baf2703261a0c67f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:26:42.964393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.965005 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-5ecba83b-d03e-43d5-a9be-7b4ddddde1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:26:42.966531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1380/2740] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:26:42 2022] DELETE /identity/v3/projects/cf74759387604b4baf2703261a0c67f2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:42.972082 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b776-840c-4de6-9cd7-e261c2c6c2da None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:42.972603 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b776-840c-4de6-9cd7-e261c2c6c2da None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:42.972712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2b776-840c-4de6-9cd7-e261c2c6c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:42.991602 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-11c2b776-840c-4de6-9cd7-e261c2c6c2da None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:42.992827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-11c2b776-840c-4de6-9cd7-e261c2c6c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:43.049938 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1361/2741] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:43.107904 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e20f-8a55-4934-a5e5-1fc8a8ac0f4b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.108187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e20f-8a55-4934-a5e5-1fc8a8ac0f4b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.108460 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824e20f-8a55-4934-a5e5-1fc8a8ac0f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.127563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-f824e20f-8a55-4934-a5e5-1fc8a8ac0f4b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:43.128752 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f824e20f-8a55-4934-a5e5-1fc8a8ac0f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:43.136478 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1381/2742] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:43.140514 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2b776-840c-4de6-9cd7-e261c2c6c2da None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:43.150397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2b776-840c-4de6-9cd7-e261c2c6c2da None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:43.154902 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:43.155552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.155833 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.156106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.156852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:26:43.157157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:43.158743 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:43.170100 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1362/2743] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:26:43.174576 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e20f-8a55-4934-a5e5-1fc8a8ac0f4b None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:43.185764 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824e20f-8a55-4934-a5e5-1fc8a8ac0f4b None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:43.191279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:43.191920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.192202 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.192474 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.193167 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:43.195072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:43.221066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1382/2744] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:43 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:43.225283 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:43.235259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36db2f-9362-4ce8-b406-0a0c56d96632 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:43.247535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:43.301349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:43.302028 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.302316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.302596 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.303323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:43.305251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:43.325376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1363/2745] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:43 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:43.330191 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:43.340337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66150df5-b750-4d75-9a2a-f4724d4c8596 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:43.345590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:43.346245 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.346529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.346805 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.347555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:43.349150 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:43.359452 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1383/2746] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:43.363449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:43.373419 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0cfb4-f51e-47d4-86dc-ef460ed65a55 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:43.378481 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d4493-601f-457e-b186-30e92bd32504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:43.379186 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4493-601f-457e-b186-30e92bd32504 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.379502 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4493-601f-457e-b186-30e92bd32504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.379778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d4493-601f-457e-b186-30e92bd32504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.380544 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d4493-601f-457e-b186-30e92bd32504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:43.382134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072d4493-601f-457e-b186-30e92bd32504 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:43.392753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1364/2747] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:43.396822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:43.407326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0ff17-ac02-4eae-b988-ba45a0490f73 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:43.411957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:43.412834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.413123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.413404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] PATH_INFO: `/v3/projects/ab558ce1d5de4e2598c993104800c04c/users/0018a29e83c44e5192a9cc744ea030a8/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.428007 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab558ce1d5de4e2598c993104800c04c, user_id=0018a29e83c44e5192a9cc744ea030a8, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:43.430666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:43.443967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1384/2748] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:43 2022] PUT /identity/v3/projects/ab558ce1d5de4e2598c993104800c04c/users/0018a29e83c44e5192a9cc744ea030a8/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:43.448947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766595-92dd-4be9-91a1-63afa65c6742 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.449304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766595-92dd-4be9-91a1-63afa65c6742 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.449589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e766595-92dd-4be9-91a1-63afa65c6742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.467739 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-4e766595-92dd-4be9-91a1-63afa65c6742 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:43.469527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4e766595-92dd-4be9-91a1-63afa65c6742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:43.527663 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1365/2749] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:43.537547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:43.539306 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:43.596011 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781a6aa-fc45-4105-bdb7-b88fa504586a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:43.599685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:43.600326 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:43.600612 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:43.600889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:43.609843 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:43.611304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:43.620965 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1385/2750] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:44.493550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e789-0b5a-485b-810a-50e0ce4d6acb None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:44.494008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e789-0b5a-485b-810a-50e0ce4d6acb None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:44.494133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e789-0b5a-485b-810a-50e0ce4d6acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:44.521574 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d612e789-0b5a-485b-810a-50e0ce4d6acb None None] MFA Rules not processed for user `0018a29e83c44e5192a9cc744ea030a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:44.522921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d612e789-0b5a-485b-810a-50e0ce4d6acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:44.588126 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1366/2751] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:44.592503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:44.602256 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21822-068e-4b97-8f45-53981ec32997 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:44.606792 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:44.607485 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:44.607751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:44.608028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:44.608716 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:44.610637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:44.642886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1386/2752] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:26:44 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:26:44.644712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e789-0b5a-485b-810a-50e0ce4d6acb None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:44.655484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e789-0b5a-485b-810a-50e0ce4d6acb None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:44.679961 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:44.712592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:44.713271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:44.713559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:44.713839 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:44.714566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:44.716499 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:44.736651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1367/2753] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:26:44 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:26:44.740547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:44.751195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0fc791-984c-4760-b93d-d6150bc69493 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:44.755738 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:44.756417 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:44.756696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:44.756970 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:44.757684 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:44.759308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:44.770072 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1387/2754] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:44.774060 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:44.783945 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724cdd5-518c-4f35-81c6-c03b115e8213 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:44.788612 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:44.789518 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:44.789802 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:44.790079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] PATH_INFO: `/v3/projects/6574fa32221d4115af79a55cd9848b2f/users/c1c7d6cfc1d04db9bb25d24178eee084/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:44.805188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6574fa32221d4115af79a55cd9848b2f, user_id=c1c7d6cfc1d04db9bb25d24178eee084, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:44.807876 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:44.821177 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1368/2755] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:44 2022] PUT /identity/v3/projects/6574fa32221d4115af79a55cd9848b2f/users/c1c7d6cfc1d04db9bb25d24178eee084/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:26:44.825109 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:44.835024 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f602ec-0d16-41e4-baf1-cf37c4173d21 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:44.876903 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:44.893366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec0d49-a037-417d-ab85-3b6c6e61d313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:44.894036 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0d49-a037-417d-ab85-3b6c6e61d313 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:44.894319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0d49-a037-417d-ab85-3b6c6e61d313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:44.894593 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec0d49-a037-417d-ab85-3b6c6e61d313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:44.895349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec0d49-a037-417d-ab85-3b6c6e61d313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:44.896988 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ec0d49-a037-417d-ab85-3b6c6e61d313 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:44.906457 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1388/2756] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:26:44.910527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:44.920678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff8c99-682e-41a1-8eaa-ad73d6d64411 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:44.929995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0b805-1fa0-4ced-be46-cbe2ad74dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:44.930927 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0b805-1fa0-4ced-be46-cbe2ad74dc93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:44.931535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0b805-1fa0-4ced-be46-cbe2ad74dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:44.931535 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0b805-1fa0-4ced-be46-cbe2ad74dc93 admin admin] PATH_INFO: `/v3/projects/6574fa32221d4115af79a55cd9848b2f/users/c1c7d6cfc1d04db9bb25d24178eee084/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:44.933472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0b805-1fa0-4ced-be46-cbe2ad74dc93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6574fa32221d4115af79a55cd9848b2f, user_id=c1c7d6cfc1d04db9bb25d24178eee084, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:44.937218 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0b805-1fa0-4ced-be46-cbe2ad74dc93 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:44.949889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1369/2757] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:26:44 2022] PUT /identity/v3/projects/6574fa32221d4115af79a55cd9848b2f/users/c1c7d6cfc1d04db9bb25d24178eee084/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:26:45.577384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:45.577704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:45.578487 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:45.605246 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] MFA Rules not processed for user `c1c7d6cfc1d04db9bb25d24178eee084`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:45.606993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:45.679664 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1389/2758] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:45.691359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3565d-0652-4df1-aa58-4142b0969c4a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:45.691884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3565d-0652-4df1-aa58-4142b0969c4a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:45.691983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c3565d-0652-4df1-aa58-4142b0969c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:45.710130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-49c3565d-0652-4df1-aa58-4142b0969c4a None None] MFA Rules not processed for user `0018a29e83c44e5192a9cc744ea030a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:26:45.711376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-49c3565d-0652-4df1-aa58-4142b0969c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:45.768619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1370/2759] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:26:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:26:45.781758 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:45.783343 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:45.867114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb61160-4084-493e-a8aa-dbe28fb3d31d None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:45.872533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8a59979309a45f98c0b4fb27af83c6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:45.873179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:45.873466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:45.873746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:45.881971 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:45.883586 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:45.892835 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1390/2760] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:46.116826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3565d-0652-4df1-aa58-4142b0969c4a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:46.170361 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c3565d-0652-4df1-aa58-4142b0969c4a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:46.174349 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:46.175031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:46.175320 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:46.175599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:46.177366 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:46.186879 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:46.188820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:46.196792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1371/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:26:55.888302 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=82 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:56.193229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:26:59.743511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:26:59.744923 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:26:59.800737 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589cd0b2-91c2-477e-8112-16d992b36671 service nova] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:26:59.804217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:26:59.804843 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:26:59.805123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:26:59.805393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:26:59.814144 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:26:59.816172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:26:59.825338 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1391/2762] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:26:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:09.821210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=26 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:18.626613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:18.631631 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:18.643247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423b35d-ceb7-4490-91ec-7b7986f6e128 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:18.647667 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:18.648380 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:18.648727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:18.649069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:18.650905 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:18.721277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:18.722709 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:18.733360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1372/2763] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:19.632658 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:19.650060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b7e6e-373c-4958-8ca4-8dbe2846e065 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:19.655021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:19.655959 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:19.656488 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:19.656825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] PATH_INFO: `/v3/users/0018a29e83c44e5192a9cc744ea030a8` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:19.658214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0018a29e83c44e5192a9cc744ea030a8)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:19.660892 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:19.711354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0018a29e83c44e5192a9cc744ea030a8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:19.719197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0018a29e83c44e5192a9cc744ea030a8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:19.720324 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0018a29e83c44e5192a9cc744ea030a8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:19.732415 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0018a29e83c44e5192a9cc744ea030a8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:19.733079 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0018a29e83c44e5192a9cc744ea030a8'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:19.746249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1392/2764] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:19 2022] DELETE /identity/v3/users/0018a29e83c44e5192a9cc744ea030a8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:19.924351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:19.934579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e582770-a9a6-4b9a-b562-e2f737731b74 service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:20.017266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:20.018156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:20.019027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:20.019449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] PATH_INFO: `/v3/projects/ab558ce1d5de4e2598c993104800c04c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:20.020922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab558ce1d5de4e2598c993104800c04c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:20.022921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:20.078429 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab558ce1d5de4e2598c993104800c04c', 'request_id': 'req-701e92b2-80b8-4388-9dc4-f9fdd3957745'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.088374 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab558ce1d5de4e2598c993104800c04c', 'request_id': 'req-701e92b2-80b8-4388-9dc4-f9fdd3957745'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.095290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab558ce1d5de4e2598c993104800c04c', 'request_id': 'req-701e92b2-80b8-4388-9dc4-f9fdd3957745'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.107343 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] The token cache is being invalidate because project ab558ce1d5de4e2598c993104800c04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:20.107710 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.108442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.110552 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1373/2765] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:19 2022] DELETE /identity/v3/projects/ab558ce1d5de4e2598c993104800c04c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:20.115119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:20.116727 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:20.131756 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cacf27-5a0d-4328-82f5-c23d79104636 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:20.196763 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:20.197642 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:20.197922 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:20.198196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] PATH_INFO: `/v3/users/c1c7d6cfc1d04db9bb25d24178eee084` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:20.199393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c7d6cfc1d04db9bb25d24178eee084)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:20.201301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:20.249195 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c7d6cfc1d04db9bb25d24178eee084'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.257777 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c7d6cfc1d04db9bb25d24178eee084'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.258546 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c7d6cfc1d04db9bb25d24178eee084'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.271107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c7d6cfc1d04db9bb25d24178eee084'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.271765 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-951dd737-f57a-42e3-8f61-a94216deee05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c7d6cfc1d04db9bb25d24178eee084'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.273741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:20.286403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1393/2766] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:20 2022] DELETE /identity/v3/users/c1c7d6cfc1d04db9bb25d24178eee084 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:20.477647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:20.479059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:20.496495 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e92b2-80b8-4388-9dc4-f9fdd3957745 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:20.519649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:20.566234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:20.567255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:20.567616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:20.567997 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] PATH_INFO: `/v3/projects/6574fa32221d4115af79a55cd9848b2f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:20.569231 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6574fa32221d4115af79a55cd9848b2f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:20.571284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:20.637318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6574fa32221d4115af79a55cd9848b2f', 'request_id': 'req-1813a834-e007-4a7c-a505-046cfc8a4e1a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.646823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6574fa32221d4115af79a55cd9848b2f', 'request_id': 'req-1813a834-e007-4a7c-a505-046cfc8a4e1a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.654537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6574fa32221d4115af79a55cd9848b2f', 'request_id': 'req-1813a834-e007-4a7c-a505-046cfc8a4e1a'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.666559 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] The token cache is being invalidate because project 6574fa32221d4115af79a55cd9848b2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:20.666885 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.668290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-1813a834-e007-4a7c-a505-046cfc8a4e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:20.670053 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1374/2767] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:20 2022] DELETE /identity/v3/projects/6574fa32221d4115af79a55cd9848b2f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:20.675701 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f493c0-7d95-4ed8-b028-c8279d28ccbb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:20.676237 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f493c0-7d95-4ed8-b028-c8279d28ccbb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:20.676366 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f493c0-7d95-4ed8-b028-c8279d28ccbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:20.701372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-86f493c0-7d95-4ed8-b028-c8279d28ccbb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:20.703739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-86f493c0-7d95-4ed8-b028-c8279d28ccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:20.787789 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1394/2768] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:20.795364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295639f-073a-471d-96c3-f2e86d982b69 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:20.795662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295639f-073a-471d-96c3-f2e86d982b69 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:20.795948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295639f-073a-471d-96c3-f2e86d982b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:20.818031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-8295639f-073a-471d-96c3-f2e86d982b69 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:20.819659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-8295639f-073a-471d-96c3-f2e86d982b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:20.829285 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1375/2769] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:20.833531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f493c0-7d95-4ed8-b028-c8279d28ccbb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:20.844055 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f493c0-7d95-4ed8-b028-c8279d28ccbb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:20.849654 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:20.850313 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:20.850597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:20.850909 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:20.851644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:27:20.852212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:20.853739 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:20.871172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1395/2770] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:27:20.872398 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295639f-073a-471d-96c3-f2e86d982b69 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:20.882935 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295639f-073a-471d-96c3-f2e86d982b69 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:20.887722 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:20.888387 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:20.888671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:20.889083 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:20.890206 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:20.891868 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:20.920854 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1376/2771] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:20 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:20.925689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:20.936534 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05cce3-7988-4db4-a367-9c6347bc33ed admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:21.003755 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:21.004437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.004722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.005022 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.005715 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:21.007672 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:21.036613 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1396/2772] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:20 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:21.037800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:21.050449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bc204-0369-462d-ba37-39cdce049556 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:21.056280 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:21.056960 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.057251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.057536 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.058273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:21.059916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:21.071227 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1377/2773] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:27:21.075067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:21.086981 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f0332-7ae3-4c23-9999-763fb031f07c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:21.092123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6e8bf-f2fd-40db-ba74-8d6952221fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:21.093720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6e8bf-f2fd-40db-ba74-8d6952221fab admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.093720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6e8bf-f2fd-40db-ba74-8d6952221fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.093720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6e8bf-f2fd-40db-ba74-8d6952221fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.094376 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6e8bf-f2fd-40db-ba74-8d6952221fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:21.096126 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6e8bf-f2fd-40db-ba74-8d6952221fab admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:21.107565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1397/2774] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:21.111586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:21.122768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7eb799-2512-401e-a166-e4c24f6ce095 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:21.127962 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:21.128884 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.129179 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.129455 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] PATH_INFO: `/v3/projects/7ec328acc0d54ef8a2615b6b6841542b/users/363d5c7f4f1742629fa9994950f52c2e/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.148096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec328acc0d54ef8a2615b6b6841542b, user_id=363d5c7f4f1742629fa9994950f52c2e, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:21.152172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:21.173790 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1378/2775] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:21 2022] PUT /identity/v3/projects/7ec328acc0d54ef8a2615b6b6841542b/users/363d5c7f4f1742629fa9994950f52c2e/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:27:21.184799 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97cc3-30fd-4434-89de-7bdf5803dabb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.185148 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97cc3-30fd-4434-89de-7bdf5803dabb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.185437 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba97cc3-30fd-4434-89de-7bdf5803dabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.212172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3ba97cc3-30fd-4434-89de-7bdf5803dabb None None] MFA Rules not processed for user `363d5c7f4f1742629fa9994950f52c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:21.213421 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3ba97cc3-30fd-4434-89de-7bdf5803dabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:21.260840 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:21.282081 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1398/2776] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:21.296134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:21.298200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:21.356515 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e171840-5723-4636-bf5f-4bd5cdabacfc admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:21.360158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbf050-8bcd-4faa-a377-cb308fcdf307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:21.360829 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbf050-8bcd-4faa-a377-cb308fcdf307 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.361111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbf050-8bcd-4faa-a377-cb308fcdf307 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.361385 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbf050-8bcd-4faa-a377-cb308fcdf307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.366798 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:21.370871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbf050-8bcd-4faa-a377-cb308fcdf307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:21.372727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbf050-8bcd-4faa-a377-cb308fcdf307 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:21.383446 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1379/2777] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:21.402655 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97cc3-30fd-4434-89de-7bdf5803dabb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:21.472012 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba97cc3-30fd-4434-89de-7bdf5803dabb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:21.476819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:21.477954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.478348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.478725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] PATH_INFO: `/v3/users/363d5c7f4f1742629fa9994950f52c2e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.480205 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=363d5c7f4f1742629fa9994950f52c2e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:21.482319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:21.538615 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '363d5c7f4f1742629fa9994950f52c2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:21.548418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '363d5c7f4f1742629fa9994950f52c2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:21.550876 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '363d5c7f4f1742629fa9994950f52c2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:21.566135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '363d5c7f4f1742629fa9994950f52c2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:21.567639 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '363d5c7f4f1742629fa9994950f52c2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:21.582874 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1399/2778] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:21 2022] DELETE /identity/v3/users/363d5c7f4f1742629fa9994950f52c2e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:21.587421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.587712 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.588012 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.607692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:21.608899 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:21.697918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1380/2779] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:21.708077 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:21.710497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:21.769003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1641927-3b65-43dd-9d81-a2eabfa91c2d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:21.773327 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:21.773992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:21.774279 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:21.774565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:21.785242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:21.786960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:21.797065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1400/2780] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:22.117613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:22.119609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:22.136539 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9490b2f-5f28-4603-a3b3-642b5784135b None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:22.147379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:22.148453 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:22.148918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:22.149383 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] PATH_INFO: `/v3/projects/7ec328acc0d54ef8a2615b6b6841542b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:22.151140 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec328acc0d54ef8a2615b6b6841542b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:22.153278 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:22.179561 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:22.181127 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:22.201897 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30341dd-cd1e-4519-8054-c3da2cf1522d service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:22.206630 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:22.207542 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:22.207820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:22.208110 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] PATH_INFO: `/v3/users/a8c886f340524f81a7bb8223269ae8b7` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:22.209384 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c886f340524f81a7bb8223269ae8b7)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:22.211391 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:22.214341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:22.219566 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec328acc0d54ef8a2615b6b6841542b', 'request_id': 'req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.228611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec328acc0d54ef8a2615b6b6841542b', 'request_id': 'req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.234524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec328acc0d54ef8a2615b6b6841542b', 'request_id': 'req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.249070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] The token cache is being invalidate because project 7ec328acc0d54ef8a2615b6b6841542b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:22.249451 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.250459 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.256238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1381/2781] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:22 2022] DELETE /identity/v3/projects/7ec328acc0d54ef8a2615b6b6841542b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:22.270287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c886f340524f81a7bb8223269ae8b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.279131 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c886f340524f81a7bb8223269ae8b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.288667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c886f340524f81a7bb8223269ae8b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.310948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c886f340524f81a7bb8223269ae8b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.311856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-81409100-17b5-46d9-aad9-7fad3faa1042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c886f340524f81a7bb8223269ae8b7'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.330003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1401/2782] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:22 2022] DELETE /identity/v3/users/a8c886f340524f81a7bb8223269ae8b7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:27:22.541851 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:22.543364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:22.616362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b2fa3-c579-4c91-a95d-66d7474eb7d9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:22.638510 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:22.677099 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:22.677964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:22.678255 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:22.678537 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] PATH_INFO: `/v3/projects/63ecce0d967f4b44979211260933d760` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:22.679753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63ecce0d967f4b44979211260933d760)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:22.681665 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:22.728472 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63ecce0d967f4b44979211260933d760', 'request_id': 'req-364954db-0595-41d1-bffa-a2e4ac5d8d66'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.738513 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63ecce0d967f4b44979211260933d760', 'request_id': 'req-364954db-0595-41d1-bffa-a2e4ac5d8d66'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.743804 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63ecce0d967f4b44979211260933d760', 'request_id': 'req-364954db-0595-41d1-bffa-a2e4ac5d8d66'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.756917 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] The token cache is being invalidate because project 63ecce0d967f4b44979211260933d760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:22.757240 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.757900 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-364954db-0595-41d1-bffa-a2e4ac5d8d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:22.759527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1382/2783] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:22 2022] DELETE /identity/v3/projects/63ecce0d967f4b44979211260933d760 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:27:22.767029 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5907a0-4389-4171-b2e9-886e3744b187 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:22.767563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5907a0-4389-4171-b2e9-886e3744b187 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:22.767686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5907a0-4389-4171-b2e9-886e3744b187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:22.786304 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-cf5907a0-4389-4171-b2e9-886e3744b187 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:22.787551 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-cf5907a0-4389-4171-b2e9-886e3744b187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:22.846142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1402/2784] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:22.854428 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5f0a1-d551-41f2-b189-3aa2e3b0b42c None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:22.854723 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5f0a1-d551-41f2-b189-3aa2e3b0b42c None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:22.855039 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5f0a1-d551-41f2-b189-3aa2e3b0b42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:22.874148 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-a7f5f0a1-d551-41f2-b189-3aa2e3b0b42c None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:22.875377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-a7f5f0a1-d551-41f2-b189-3aa2e3b0b42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:22.883226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1383/2785] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:22.887365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5907a0-4389-4171-b2e9-886e3744b187 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:22.897718 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5907a0-4389-4171-b2e9-886e3744b187 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:22.902711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:22.903396 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:22.903685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:22.903963 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:22.904686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:27:22.904993 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:22.906584 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:22.919017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1403/2786] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:27:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 20:27:22.923473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5f0a1-d551-41f2-b189-3aa2e3b0b42c None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:22.932761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5f0a1-d551-41f2-b189-3aa2e3b0b42c None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:22.937425 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:22.938075 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:22.938359 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:22.938635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:22.939372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:22.941761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:22.967910 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1384/2787] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:22 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:27:22.971885 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:22.981861 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577fd49-c43e-4277-8f08-452365b51f76 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:23.037627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:23.038519 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:23.038810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:23.039115 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:23.039810 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:23.041725 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:23.056235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:23.063495 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1404/2788] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:22 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:23.068795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:23.079423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfedf56e-814f-4292-8cd4-13c6eb165431 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:23.084736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:23.085397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:23.085678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:23.085951 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:23.086676 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:23.088381 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:23.098755 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1385/2789] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:27:23.102781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:23.112741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470871f-934e-421c-b8fc-0512c41b088b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:23.117603 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8353896-2364-4447-a120-fa5156445b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:23.118262 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353896-2364-4447-a120-fa5156445b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:23.118553 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353896-2364-4447-a120-fa5156445b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:23.118833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8353896-2364-4447-a120-fa5156445b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:23.119579 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8353896-2364-4447-a120-fa5156445b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:23.121185 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8353896-2364-4447-a120-fa5156445b5b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:23.131502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1405/2790] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:23.135501 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:23.145770 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4422737-6457-4b80-83c3-020eddd0e21f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:23.150274 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:23.151271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:23.151553 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:23.151830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] PATH_INFO: `/v3/projects/c814603d65864ff5a333aefa3a349075/users/1bce75f327d7476cb34620517a34ab2e/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:23.165916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c814603d65864ff5a333aefa3a349075, user_id=1bce75f327d7476cb34620517a34ab2e, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:23.168557 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:23.181443 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1386/2791] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:23 2022] PUT /identity/v3/projects/c814603d65864ff5a333aefa3a349075/users/1bce75f327d7476cb34620517a34ab2e/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:23.191791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d99ef5-e65c-4827-a32b-e962aec761fd None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:23.192087 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d99ef5-e65c-4827-a32b-e962aec761fd None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:23.192369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d99ef5-e65c-4827-a32b-e962aec761fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:23.219095 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-c2d99ef5-e65c-4827-a32b-e962aec761fd None None] MFA Rules not processed for user `1bce75f327d7476cb34620517a34ab2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:23.220686 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c2d99ef5-e65c-4827-a32b-e962aec761fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:23.283650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1406/2792] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:27:23.294084 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:23.295778 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:23.352692 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48186eb-5c48-4f8d-bc48-5e834348cb61 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:23.356284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d381d1f8-8d55-4f4d-90b4-56ef1936223b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:23.356916 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d1f8-8d55-4f4d-90b4-56ef1936223b service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:23.357199 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d1f8-8d55-4f4d-90b4-56ef1936223b service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:23.357473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d381d1f8-8d55-4f4d-90b4-56ef1936223b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:23.363143 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:23.367335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381d1f8-8d55-4f4d-90b4-56ef1936223b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:23.368849 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d381d1f8-8d55-4f4d-90b4-56ef1936223b service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:23.379572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1387/2793] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:31.635471 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d99ef5-e65c-4827-a32b-e962aec761fd None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:31.697749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d99ef5-e65c-4827-a32b-e962aec761fd None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:31.702120 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:31.703004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:31.703286 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:31.703557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] PATH_INFO: `/v3/users/1bce75f327d7476cb34620517a34ab2e` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:31.704723 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bce75f327d7476cb34620517a34ab2e)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:31.707179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:31.754582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bce75f327d7476cb34620517a34ab2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:31.761889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bce75f327d7476cb34620517a34ab2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:31.762513 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bce75f327d7476cb34620517a34ab2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:31.774719 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bce75f327d7476cb34620517a34ab2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:31.775378 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bce75f327d7476cb34620517a34ab2e'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:31.780502 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:31.790636 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1407/2794] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:31 2022] DELETE /identity/v3/users/1bce75f327d7476cb34620517a34ab2e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:31.795029 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:31.795509 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:31.795619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:31.812733 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:31.813920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:31.873063 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1388/2795] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:31.882531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:31.883960 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:31.942197 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64002a-f820-4829-a742-e55bce8f5a0b admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:31.945936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12733b24-e94e-4f2e-ac9f-d3e0f4fb8152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:31.946575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733b24-e94e-4f2e-ac9f-d3e0f4fb8152 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:31.946881 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733b24-e94e-4f2e-ac9f-d3e0f4fb8152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:31.947162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12733b24-e94e-4f2e-ac9f-d3e0f4fb8152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:31.956617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12733b24-e94e-4f2e-ac9f-d3e0f4fb8152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:31.958039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12733b24-e94e-4f2e-ac9f-d3e0f4fb8152 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:31.967399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1408/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:32.229629 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.231101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:32.245155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e45edb-ecca-4df6-8bb8-cedab04dbec5 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.249776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.251370 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.251662 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.251943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] PATH_INFO: `/v3/projects/c814603d65864ff5a333aefa3a349075` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.253683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c814603d65864ff5a333aefa3a349075)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.255624 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.303592 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c814603d65864ff5a333aefa3a349075', 'request_id': 'req-93426bb6-dc62-4574-ba8d-3e391033f506'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:32.310447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c814603d65864ff5a333aefa3a349075', 'request_id': 'req-93426bb6-dc62-4574-ba8d-3e391033f506'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:32.316424 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c814603d65864ff5a333aefa3a349075', 'request_id': 'req-93426bb6-dc62-4574-ba8d-3e391033f506'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:32.327449 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] The token cache is being invalidate because project c814603d65864ff5a333aefa3a349075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:32.327736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:32.328355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-93426bb6-dc62-4574-ba8d-3e391033f506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:32.329870 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1389/2797] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:32 2022] DELETE /identity/v3/projects/c814603d65864ff5a333aefa3a349075 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:32.334943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972879c2-a1d0-429b-93f3-6521942665ef None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.335333 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972879c2-a1d0-429b-93f3-6521942665ef None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.335689 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972879c2-a1d0-429b-93f3-6521942665ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.354015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-972879c2-a1d0-429b-93f3-6521942665ef None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:32.355249 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-972879c2-a1d0-429b-93f3-6521942665ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:32.412704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1409/2798] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:32.421452 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19ee4-edcd-48c9-bfbc-53ea4c8c1a74 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.422009 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19ee4-edcd-48c9-bfbc-53ea4c8c1a74 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.422289 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a19ee4-edcd-48c9-bfbc-53ea4c8c1a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.441292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b6a19ee4-edcd-48c9-bfbc-53ea4c8c1a74 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:32.442485 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b6a19ee4-edcd-48c9-bfbc-53ea4c8c1a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:32.450293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1390/2799] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:32.454257 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972879c2-a1d0-429b-93f3-6521942665ef None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.463967 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972879c2-a1d0-429b-93f3-6521942665ef None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.468440 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.469083 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.469393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.469690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.470404 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:27:32.470706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.472318 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.483555 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1410/2800] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:27:32.488478 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a19ee4-edcd-48c9-bfbc-53ea4c8c1a74 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.497711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a19ee4-edcd-48c9-bfbc-53ea4c8c1a74 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.502356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.503649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.503940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.504217 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.504912 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.506812 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.531841 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1391/2801] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:32 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:27:32.536000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.545741 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92ce00-9b3b-433f-9a96-9720544b3373 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.605358 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.606066 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.606312 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.606590 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.607308 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.609210 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.633056 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1411/2802] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:32 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:32.634863 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.645059 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91e439-88f4-4c7b-b183-6574141f4424 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.649651 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.650305 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.650589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.650897 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.651673 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.653219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.663550 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1392/2803] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:32.667355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.677888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e69b0-a5a1-4e81-9110-450fa161e77d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.682355 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d004a5-4bfa-46ab-beb3-20c8cb2c6949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.683033 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d004a5-4bfa-46ab-beb3-20c8cb2c6949 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.683315 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d004a5-4bfa-46ab-beb3-20c8cb2c6949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.683589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d004a5-4bfa-46ab-beb3-20c8cb2c6949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.684301 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d004a5-4bfa-46ab-beb3-20c8cb2c6949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.685880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d004a5-4bfa-46ab-beb3-20c8cb2c6949 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.696696 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1412/2804] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:32.700558 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.710357 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acba36a-169a-4824-abdf-6fcea9e7d4c9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.715070 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.715948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.716237 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.716517 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] PATH_INFO: `/v3/projects/2da42e08167e43feb85bd2d1c7829559/users/bfbcfdf168a2405e87d2e585c3396234/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.731448 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da42e08167e43feb85bd2d1c7829559, user_id=bfbcfdf168a2405e87d2e585c3396234, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.734088 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.747583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1393/2805] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:32 2022] PUT /identity/v3/projects/2da42e08167e43feb85bd2d1c7829559/users/bfbcfdf168a2405e87d2e585c3396234/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:32.758060 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a598760-a692-45fc-9220-84db02839771 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.758349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a598760-a692-45fc-9220-84db02839771 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.758629 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a598760-a692-45fc-9220-84db02839771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.765493 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:32.786163 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3a598760-a692-45fc-9220-84db02839771 None None] MFA Rules not processed for user `bfbcfdf168a2405e87d2e585c3396234`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:32.787403 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3a598760-a692-45fc-9220-84db02839771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:32.850390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1413/2806] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:32.854867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.868614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:32.917939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8085c39-b1db-4834-8743-a4e05d1e0555 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:32.922689 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:32.923368 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:32.923657 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:32.923928 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:32.925234 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:32.927205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:32.951844 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1394/2807] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:32 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:27:32.955907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a598760-a692-45fc-9220-84db02839771 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:32.966456 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a598760-a692-45fc-9220-84db02839771 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:33.024123 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:33.024791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.025078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.025357 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.026052 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:33.027997 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:33.048004 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1414/2808] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:32 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:33.053089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:33.063111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42231e-ae30-41e8-9ae2-e7bac870883f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:33.067659 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:33.068304 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.068585 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.068859 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.069579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:33.071197 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:33.081980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1395/2809] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:33.085898 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:33.095731 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc50370-2471-4e60-bcd9-3100e7b090ce admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:33.100870 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:33.101735 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.102016 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.102287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] PATH_INFO: `/v3/projects/e0f110ef9aba487ab1f1e0ffc088811c/users/0dcd55d112ab4c298d11ee70c0036298/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.118565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f110ef9aba487ab1f1e0ffc088811c, user_id=0dcd55d112ab4c298d11ee70c0036298, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:33.121268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:33.135884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1415/2810] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:33 2022] PUT /identity/v3/projects/e0f110ef9aba487ab1f1e0ffc088811c/users/0dcd55d112ab4c298d11ee70c0036298/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:33.139788 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:33.150031 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3f92f-2b74-4050-953e-3ce9ff914be6 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:33.206135 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2161c1e-d192-4bc3-830b-490f651822fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:33.206819 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2161c1e-d192-4bc3-830b-490f651822fd admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.207136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2161c1e-d192-4bc3-830b-490f651822fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.207447 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2161c1e-d192-4bc3-830b-490f651822fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.208182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2161c1e-d192-4bc3-830b-490f651822fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:33.209785 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2161c1e-d192-4bc3-830b-490f651822fd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:33.219473 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1396/2811] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:33.223666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:33.234025 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086e115c-2db1-4a9c-a3b3-c235cbb3bd73 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:33.239292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:33.240201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.240482 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.240759 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] PATH_INFO: `/v3/projects/e0f110ef9aba487ab1f1e0ffc088811c/users/0dcd55d112ab4c298d11ee70c0036298/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.242708 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0f110ef9aba487ab1f1e0ffc088811c, user_id=0dcd55d112ab4c298d11ee70c0036298, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:33.245397 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:33.256278 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1416/2812] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:33 2022] PUT /identity/v3/projects/e0f110ef9aba487ab1f1e0ffc088811c/users/0dcd55d112ab4c298d11ee70c0036298/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:33.266241 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31133-d3f3-45b8-851b-f6b61630e1f2 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.266599 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31133-d3f3-45b8-851b-f6b61630e1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.266911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea31133-d3f3-45b8-851b-f6b61630e1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.293505 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-fea31133-d3f3-45b8-851b-f6b61630e1f2 None None] MFA Rules not processed for user `0dcd55d112ab4c298d11ee70c0036298`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:33.294696 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fea31133-d3f3-45b8-851b-f6b61630e1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:33.362698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1397/2813] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:33.373783 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:33.375532 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:33.434906 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:33.441888 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7434-24b7-4f5b-93e9-249e8b023650 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:33.446017 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:33.446667 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.446983 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.447296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.456918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:33.458319 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:33.467549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1417/2814] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:33.538121 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31133-d3f3-45b8-851b-f6b61630e1f2 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:33.547880 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea31133-d3f3-45b8-851b-f6b61630e1f2 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:33.551998 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebbce9-a299-4c21-a4ed-2994021963c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:33.552634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebbce9-a299-4c21-a4ed-2994021963c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:33.552914 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebbce9-a299-4c21-a4ed-2994021963c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:33.553189 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebbce9-a299-4c21-a4ed-2994021963c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:33.558232 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:33.608983 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebbce9-a299-4c21-a4ed-2994021963c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:33.610412 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebbce9-a299-4c21-a4ed-2994021963c4 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:33.619835 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1398/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:40.518451 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:40.585222 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4f4ac-36ec-4ad4-a724-d510d7c97d5a service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:40.589666 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:40.590531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:40.590808 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:40.591107 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] PATH_INFO: `/v3/users/bfbcfdf168a2405e87d2e585c3396234` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:40.592273 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbcfdf168a2405e87d2e585c3396234)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:40.594176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:40.642957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbcfdf168a2405e87d2e585c3396234'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:40.650169 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbcfdf168a2405e87d2e585c3396234'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:40.650848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbcfdf168a2405e87d2e585c3396234'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:40.662637 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbcfdf168a2405e87d2e585c3396234'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:40.663296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbcfdf168a2405e87d2e585c3396234'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:40.675844 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1418/2816] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:40 2022] DELETE /identity/v3/users/bfbcfdf168a2405e87d2e585c3396234 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:40.680889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:40.681376 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:40.681475 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:40.698737 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:40.699964 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:40.761150 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1399/2817] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:40.770820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:40.772264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:40.828530 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3446f1-db96-487f-ace4-e8557f02ac9a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:40.832152 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:40.832793 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:40.833217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:40.833510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:40.842450 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:40.843918 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:40.853305 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1419/2818] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:41.121110 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:41.122632 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:41.135611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365212a4-d0e4-49cb-8d81-1fac7dcd7e7a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:41.140239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:41.141109 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:41.141393 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:41.141671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] PATH_INFO: `/v3/projects/2da42e08167e43feb85bd2d1c7829559` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:41.142925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da42e08167e43feb85bd2d1c7829559)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:41.144933 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:41.191795 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da42e08167e43feb85bd2d1c7829559', 'request_id': 'req-81d93f76-fc09-4a43-9909-bcf3819b7afd'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.198703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da42e08167e43feb85bd2d1c7829559', 'request_id': 'req-81d93f76-fc09-4a43-9909-bcf3819b7afd'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.204069 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da42e08167e43feb85bd2d1c7829559', 'request_id': 'req-81d93f76-fc09-4a43-9909-bcf3819b7afd'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.214762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] The token cache is being invalidate because project 2da42e08167e43feb85bd2d1c7829559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:41.215079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.215703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.217216 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1400/2819] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:41 2022] DELETE /identity/v3/projects/2da42e08167e43feb85bd2d1c7829559 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:41.221314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:41.231341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f8c496-754a-480d-a765-d289974ef582 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:41.240015 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:41.292094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:41.292962 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:41.293248 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:41.293531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] PATH_INFO: `/v3/users/0dcd55d112ab4c298d11ee70c0036298` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:41.294732 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcd55d112ab4c298d11ee70c0036298)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:41.296947 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:41.341159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcd55d112ab4c298d11ee70c0036298'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.347886 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcd55d112ab4c298d11ee70c0036298'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.349201 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcd55d112ab4c298d11ee70c0036298'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.360958 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcd55d112ab4c298d11ee70c0036298'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.361582 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-cd2df483-cfc1-408d-bbbe-4d80c95cf9e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcd55d112ab4c298d11ee70c0036298'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.373356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1420/2820] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:41 2022] DELETE /identity/v3/users/0dcd55d112ab4c298d11ee70c0036298 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:41.637205 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:41.638702 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:41.652867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d93f76-fc09-4a43-9909-bcf3819b7afd admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:41.682915 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:41.713273 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:41.714138 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:41.714426 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:41.714704 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] PATH_INFO: `/v3/projects/e0f110ef9aba487ab1f1e0ffc088811c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:41.715992 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0f110ef9aba487ab1f1e0ffc088811c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:41.717842 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:41.762358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0f110ef9aba487ab1f1e0ffc088811c', 'request_id': 'req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.769613 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0f110ef9aba487ab1f1e0ffc088811c', 'request_id': 'req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.775948 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0f110ef9aba487ab1f1e0ffc088811c', 'request_id': 'req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.786923 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] The token cache is being invalidate because project e0f110ef9aba487ab1f1e0ffc088811c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:41.787214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.787853 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-c5b49318-4d31-4a8b-89ad-3f6da01f0aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:41.789397 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1401/2821] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:41 2022] DELETE /identity/v3/projects/e0f110ef9aba487ab1f1e0ffc088811c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:41.794178 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c204-736a-40e6-9c52-54976c3032fa None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:41.794712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c204-736a-40e6-9c52-54976c3032fa None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:41.794712 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c204-736a-40e6-9c52-54976c3032fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:41.815259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-52e3c204-736a-40e6-9c52-54976c3032fa None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:41.815259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-52e3c204-736a-40e6-9c52-54976c3032fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:41.873549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1421/2822] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:41.883188 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f16e94-63c8-43c3-abb9-c146433fccdd None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:41.883479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f16e94-63c8-43c3-abb9-c146433fccdd None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:41.883775 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f16e94-63c8-43c3-abb9-c146433fccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:41.902439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-49f16e94-63c8-43c3-abb9-c146433fccdd None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:41.903758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-49f16e94-63c8-43c3-abb9-c146433fccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:41.911893 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1402/2823] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:41.915968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3c204-736a-40e6-9c52-54976c3032fa None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:41.925740 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3c204-736a-40e6-9c52-54976c3032fa None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:41.930283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:41.931003 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:41.931290 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:41.931566 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:41.932287 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:27:41.932619 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:41.934208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:41.946039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1422/2824] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:27:41.950896 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f16e94-63c8-43c3-abb9-c146433fccdd None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:41.960717 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f16e94-63c8-43c3-abb9-c146433fccdd None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:41.965389 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:41.966093 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:41.966325 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:41.966606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:41.967339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:41.969219 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:41.993586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1403/2825] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:41 2022] POST /identity/v3/projects => generated 367 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:27:41.997540 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.008009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad81adf-9be2-4dca-8c46-1096bb7b45a8 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.022145 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:42.068229 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.068890 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.069170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.069443 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.070114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.072047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.092164 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1423/2826] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:41 2022] POST /identity/v3/users => generated 284 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:42.096182 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.110156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206f7af-ee96-4939-91e7-b9015636e194 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.115354 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.116013 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.116298 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.116575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.117306 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.118922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.130006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1404/2827] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:42.133905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.143985 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196bb9-abc8-469e-a6ad-f7b06318ff07 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.148682 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52ce3b-99b5-4096-ac50-1fdc69082cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.149339 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ce3b-99b5-4096-ac50-1fdc69082cdd admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.149628 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ce3b-99b5-4096-ac50-1fdc69082cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.149916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52ce3b-99b5-4096-ac50-1fdc69082cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.150675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52ce3b-99b5-4096-ac50-1fdc69082cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.152309 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52ce3b-99b5-4096-ac50-1fdc69082cdd admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.162130 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1424/2828] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:42.166130 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.176660 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d7bf2-0b9d-4437-87cc-31b2e99019fa admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.181238 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.182309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.182604 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.182911 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] PATH_INFO: `/v3/projects/e4617451f1d24ad192edf5e5110367c0/users/74c296f7c4bb4376b90ac5b1708db303/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.197760 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4617451f1d24ad192edf5e5110367c0, user_id=74c296f7c4bb4376b90ac5b1708db303, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.200409 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.212649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1405/2829] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:42 2022] PUT /identity/v3/projects/e4617451f1d24ad192edf5e5110367c0/users/74c296f7c4bb4376b90ac5b1708db303/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:42.222688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b10c-7d82-474e-b453-b205c2fb11d8 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.223009 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b10c-7d82-474e-b453-b205c2fb11d8 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.223298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5b10c-7d82-474e-b453-b205c2fb11d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.249624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-a5d5b10c-7d82-474e-b453-b205c2fb11d8 None None] MFA Rules not processed for user `74c296f7c4bb4376b90ac5b1708db303`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:42.250851 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-a5d5b10c-7d82-474e-b453-b205c2fb11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:42.313143 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1425/2830] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:42.318247 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.375519 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:42.380158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3c112-c0bf-4a3d-9703-1f604af62fe8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.386372 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.387239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.387745 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.388239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.389044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.391146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.417527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1406/2831] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:42 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:42.421771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b10c-7d82-474e-b453-b205c2fb11d8 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.433075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5b10c-7d82-474e-b453-b205c2fb11d8 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.487920 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.488529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.489371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.489650 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.490341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.492283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.511209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1426/2832] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:42 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:42.515337 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.525822 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b49e860-3f0a-460a-a46b-eaad1982e737 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.530464 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.531160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.531450 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.531731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.532460 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.534101 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.546974 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1407/2833] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:42.551683 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.561623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea044926-164f-4173-b279-d757a9785a9e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.566220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.568094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.568094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.568094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] PATH_INFO: `/v3/projects/669e041f735b4c1c9385e528a8c6dd22/users/023f31e68690436a9a24f583bbd3569f/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.583757 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:42.587071 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=669e041f735b4c1c9385e528a8c6dd22, user_id=023f31e68690436a9a24f583bbd3569f, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.590518 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.603294 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1427/2834] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:42 2022] PUT /identity/v3/projects/669e041f735b4c1c9385e528a8c6dd22/users/023f31e68690436a9a24f583bbd3569f/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:27:42.607351 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.617757 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc856e6c-6352-4a69-9b51-377bccf5add2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.675074 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cddbff-366f-4c6b-a068-626e1c3c6328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.675746 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddbff-366f-4c6b-a068-626e1c3c6328 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.676035 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddbff-366f-4c6b-a068-626e1c3c6328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.676857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddbff-366f-4c6b-a068-626e1c3c6328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.677586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cddbff-366f-4c6b-a068-626e1c3c6328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.679213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cddbff-366f-4c6b-a068-626e1c3c6328 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.689018 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1408/2835] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:42.693174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.703389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a53f1-7631-49d3-bc39-14aafeb799ce admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.707955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.708828 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.709114 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.709395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] PATH_INFO: `/v3/projects/669e041f735b4c1c9385e528a8c6dd22/users/023f31e68690436a9a24f583bbd3569f/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.711390 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669e041f735b4c1c9385e528a8c6dd22, user_id=023f31e68690436a9a24f583bbd3569f, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.714019 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.724592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1428/2836] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:42 2022] PUT /identity/v3/projects/669e041f735b4c1c9385e528a8c6dd22/users/023f31e68690436a9a24f583bbd3569f/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:42.735500 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c4230-4ff2-413e-9d82-d0cf0b0842f7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.735796 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c4230-4ff2-413e-9d82-d0cf0b0842f7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.736103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c4230-4ff2-413e-9d82-d0cf0b0842f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.762869 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-347c4230-4ff2-413e-9d82-d0cf0b0842f7 None None] MFA Rules not processed for user `023f31e68690436a9a24f583bbd3569f`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:42.764016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-347c4230-4ff2-413e-9d82-d0cf0b0842f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:42.831342 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1409/2837] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:42.842243 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:42.844092 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:42.899720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32689d75-66e8-4998-8d99-96b43bd7def9 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:42.903351 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506b97c-05bb-4fca-aeae-0a4958c4ff08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:42.903992 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b97c-05bb-4fca-aeae-0a4958c4ff08 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:42.904284 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b97c-05bb-4fca-aeae-0a4958c4ff08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:42.904558 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506b97c-05bb-4fca-aeae-0a4958c4ff08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:42.914949 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506b97c-05bb-4fca-aeae-0a4958c4ff08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:42.916371 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506b97c-05bb-4fca-aeae-0a4958c4ff08 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:42.925717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1429/2838] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:44.185166 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c4230-4ff2-413e-9d82-d0cf0b0842f7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:44.235572 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:44.247741 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c4230-4ff2-413e-9d82-d0cf0b0842f7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:44.252545 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:44.253454 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:44.253761 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:44.254023 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] PATH_INFO: `/v3/users/74c296f7c4bb4376b90ac5b1708db303` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:44.255236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c296f7c4bb4376b90ac5b1708db303)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:44.257200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:44.302235 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c296f7c4bb4376b90ac5b1708db303'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.302824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c296f7c4bb4376b90ac5b1708db303'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.303456 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c296f7c4bb4376b90ac5b1708db303'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.310388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c296f7c4bb4376b90ac5b1708db303'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.322168 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c296f7c4bb4376b90ac5b1708db303'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.335404 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1410/2839] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:44 2022] DELETE /identity/v3/users/74c296f7c4bb4376b90ac5b1708db303 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:44.339994 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:44.340511 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:44.340620 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:44.358354 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:44.359571 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:44.416156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1430/2840] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:44.429164 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:44.450158 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:44.508136 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291cd9-34ec-4e1e-af62-6cec943d56c1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:44.511789 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:44.512442 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:44.512727 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:44.513006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:44.522365 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:44.523867 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:44.533072 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1411/2841] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:44.809927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:44.811399 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:44.824250 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224640e-43e9-46ea-a314-b3aec0cf70ec None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:44.829342 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:44.830194 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:44.830476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:44.830751 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] PATH_INFO: `/v3/projects/e4617451f1d24ad192edf5e5110367c0` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:44.833186 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4617451f1d24ad192edf5e5110367c0)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:44.834429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:44.882217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4617451f1d24ad192edf5e5110367c0', 'request_id': 'req-7b7be96f-7860-40b7-a862-5d13d065b2c3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.887707 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4617451f1d24ad192edf5e5110367c0', 'request_id': 'req-7b7be96f-7860-40b7-a862-5d13d065b2c3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.893834 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4617451f1d24ad192edf5e5110367c0', 'request_id': 'req-7b7be96f-7860-40b7-a862-5d13d065b2c3'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.906028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] The token cache is being invalidate because project e4617451f1d24ad192edf5e5110367c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:44.906314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.906989 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:44.908531 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1431/2842] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:44 2022] DELETE /identity/v3/projects/e4617451f1d24ad192edf5e5110367c0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:44.912538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:44.922291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035247e8-91e4-4f45-a5ca-db718c39944a service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:44.978922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:44.979807 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:44.980096 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:44.980379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] PATH_INFO: `/v3/users/023f31e68690436a9a24f583bbd3569f` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:44.981568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=023f31e68690436a9a24f583bbd3569f)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:44.983524 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:44.998908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:45.028584 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023f31e68690436a9a24f583bbd3569f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.029221 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023f31e68690436a9a24f583bbd3569f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.029823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023f31e68690436a9a24f583bbd3569f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.036762 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023f31e68690436a9a24f583bbd3569f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.048830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-17763c20-b7e8-42fd-9738-71446d4a94ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023f31e68690436a9a24f583bbd3569f'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.061824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1412/2843] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:44 2022] DELETE /identity/v3/users/023f31e68690436a9a24f583bbd3569f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:45.348700 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:45.350349 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:45.360821 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:45.366711 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7be96f-7860-40b7-a862-5d13d065b2c3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:45.426709 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:45.427822 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.428099 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.428369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] PATH_INFO: `/v3/projects/669e041f735b4c1c9385e528a8c6dd22` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.429533 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=669e041f735b4c1c9385e528a8c6dd22)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:45.431476 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:45.481884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669e041f735b4c1c9385e528a8c6dd22', 'request_id': 'req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.488685 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669e041f735b4c1c9385e528a8c6dd22', 'request_id': 'req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.495405 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669e041f735b4c1c9385e528a8c6dd22', 'request_id': 'req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.507427 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] The token cache is being invalidate because project 669e041f735b4c1c9385e528a8c6dd22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:45.507710 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.508321 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-816c37b9-d4a4-48fb-a779-5f0022cf0a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:45.509856 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1432/2844] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:45 2022] DELETE /identity/v3/projects/669e041f735b4c1c9385e528a8c6dd22 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:45.514703 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdca57-7e8a-4ed9-bfd1-1e8e910f2692 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.515214 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdca57-7e8a-4ed9-bfd1-1e8e910f2692 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.515335 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cdca57-7e8a-4ed9-bfd1-1e8e910f2692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.533004 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-d5cdca57-7e8a-4ed9-bfd1-1e8e910f2692 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:45.534183 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-d5cdca57-7e8a-4ed9-bfd1-1e8e910f2692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:45.592269 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1413/2845] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:27:45.600535 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e598-0e21-4193-98fb-ae2812745acb None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.600827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e598-0e21-4193-98fb-ae2812745acb None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.601105 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528e598-0e21-4193-98fb-ae2812745acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.619337 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-6528e598-0e21-4193-98fb-ae2812745acb None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:45.620529 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-6528e598-0e21-4193-98fb-ae2812745acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:45.628433 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1433/2846] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:45.632648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdca57-7e8a-4ed9-bfd1-1e8e910f2692 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:45.642463 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cdca57-7e8a-4ed9-bfd1-1e8e910f2692 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:45.647091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:45.647753 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.648037 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.648315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.649041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80412) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:27:45.649379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:45.650998 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:45.662943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1414/2847] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:27:45.667173 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528e598-0e21-4193-98fb-ae2812745acb None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:45.677061 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528e598-0e21-4193-98fb-ae2812745acb None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:45.681670 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:45.682365 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.682651 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.682964 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.683653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:45.685525 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:45.711268 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1434/2848] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:45 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:45.715229 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:45.725610 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996344ea-1cd4-434a-90ca-7417a78dda8a admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:45.781882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:45.782547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.782831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.783133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.783820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:45.786323 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:45.805751 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1415/2849] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:45 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:45.809968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:45.819996 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0bfc4-afeb-4da3-89ca-943c5ccaec8c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:45.824575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:45.825224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.825504 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.825776 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.826484 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:45.828209 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:45.839028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1435/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:45.842611 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:45.853394 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77558a62-77be-4d01-9089-6ffda8f9ffa8 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:45.858208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471e1de-b9fb-452c-8322-f036a09e8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:45.858918 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e1de-b9fb-452c-8322-f036a09e8b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.859203 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e1de-b9fb-452c-8322-f036a09e8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.859479 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471e1de-b9fb-452c-8322-f036a09e8b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.860200 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e1de-b9fb-452c-8322-f036a09e8b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:45.861820 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471e1de-b9fb-452c-8322-f036a09e8b7d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:45.867044 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:45.873319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1416/2851] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:27:45.877179 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:45.887135 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed93fce4-ca57-43ff-9798-5c241a9afbd3 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:45.891781 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:45.892661 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.892946 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.893224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] PATH_INFO: `/v3/projects/c0406f6cce0c47a189f3ce695e21126e/users/8fdf6cdc7e534e9ca1b3dd09a12664da/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.907908 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0406f6cce0c47a189f3ce695e21126e, user_id=8fdf6cdc7e534e9ca1b3dd09a12664da, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:45.911208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:45.923837 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1436/2852] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:45 2022] PUT /identity/v3/projects/c0406f6cce0c47a189f3ce695e21126e/users/8fdf6cdc7e534e9ca1b3dd09a12664da/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:45.934067 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3eb1-5c60-45ff-9b62-c4f7a98ae664 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:45.934308 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3eb1-5c60-45ff-9b62-c4f7a98ae664 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:45.934589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f3eb1-5c60-45ff-9b62-c4f7a98ae664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:45.961957 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-ac2f3eb1-5c60-45ff-9b62-c4f7a98ae664 None None] MFA Rules not processed for user `8fdf6cdc7e534e9ca1b3dd09a12664da`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:45.963208 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-ac2f3eb1-5c60-45ff-9b62-c4f7a98ae664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:46.025865 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1417/2853] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:46.030389 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.063749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:46.093717 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7dfe7-3927-44d9-97f8-4cfa78f03499 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.098990 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.099644 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.099932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.100212 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.100900 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.102796 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.126264 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1437/2854] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:46 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:46.130815 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3eb1-5c60-45ff-9b62-c4f7a98ae664 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.141467 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f3eb1-5c60-45ff-9b62-c4f7a98ae664 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.197210 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.197805 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.198091 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.198371 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] PATH_INFO: `/v3/users` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.199095 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.200996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.220654 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1418/2855] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:46 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:46.224704 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.235587 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2db5a3-d65a-42b2-9d39-337130df8f44 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.241125 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.241800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.242091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.242370 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.243159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.244787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.256091 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1438/2856] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:46.260046 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.270600 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9934b9-59e3-473b-83d3-211625616465 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.275348 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.276259 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.276547 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.276827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] PATH_INFO: `/v3/projects/e9147434d9aa4f5dab2861995b2aea35/users/0d93b9c559d041d6b3e273b8cddff942/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.291293 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9147434d9aa4f5dab2861995b2aea35, user_id=0d93b9c559d041d6b3e273b8cddff942, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.293953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.307223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1419/2857] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:46 2022] PUT /identity/v3/projects/e9147434d9aa4f5dab2861995b2aea35/users/0d93b9c559d041d6b3e273b8cddff942/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:27:46.311021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.321425 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a03be-5b21-4a39-81e8-db809751f83d admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.376905 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80975d-674a-4034-9090-99a9547cada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.377565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80975d-674a-4034-9090-99a9547cada8 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.377848 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80975d-674a-4034-9090-99a9547cada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.378124 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80975d-674a-4034-9090-99a9547cada8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.378866 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80975d-674a-4034-9090-99a9547cada8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.380954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80975d-674a-4034-9090-99a9547cada8 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.390454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1439/2858] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:46.394579 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.405157 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe1a2d-6ef3-4fff-a3d4-d2c58b14d7c5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.409769 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.410645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.410965 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.411246 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] PATH_INFO: `/v3/projects/e9147434d9aa4f5dab2861995b2aea35/users/0d93b9c559d041d6b3e273b8cddff942/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.413212 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9147434d9aa4f5dab2861995b2aea35, user_id=0d93b9c559d041d6b3e273b8cddff942, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.415871 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.426421 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1420/2859] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:46 2022] PUT /identity/v3/projects/e9147434d9aa4f5dab2861995b2aea35/users/0d93b9c559d041d6b3e273b8cddff942/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:27:46.437217 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2388-10ed-4263-ab01-b0f9ae447406 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.437549 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2388-10ed-4263-ab01-b0f9ae447406 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.437791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc2388-10ed-4263-ab01-b0f9ae447406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.464688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-3acc2388-10ed-4263-ab01-b0f9ae447406 None None] MFA Rules not processed for user `0d93b9c559d041d6b3e273b8cddff942`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:46.465825 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-3acc2388-10ed-4263-ab01-b0f9ae447406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:46.533454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1440/2860] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:46.544943 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.546920 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:46.595410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:46.608339 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc48b3b-261a-4812-bef5-0d74326b93f5 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.612292 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7bc62-bec1-43d6-80f8-3ff9162c2332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.612929 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7bc62-bec1-43d6-80f8-3ff9162c2332 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.613209 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7bc62-bec1-43d6-80f8-3ff9162c2332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.614015 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7bc62-bec1-43d6-80f8-3ff9162c2332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.622698 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7bc62-bec1-43d6-80f8-3ff9162c2332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.624215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7bc62-bec1-43d6-80f8-3ff9162c2332 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.635827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1421/2861] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:46.698057 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc2388-10ed-4263-ab01-b0f9ae447406 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.727096 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:46.765687 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc2388-10ed-4263-ab01-b0f9ae447406 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:46.770322 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:46.771224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.771505 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.771778 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] PATH_INFO: `/v3/users/8fdf6cdc7e534e9ca1b3dd09a12664da` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.772957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdf6cdc7e534e9ca1b3dd09a12664da)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:46.775193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:46.821430 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdf6cdc7e534e9ca1b3dd09a12664da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:46.828841 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdf6cdc7e534e9ca1b3dd09a12664da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:46.829477 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdf6cdc7e534e9ca1b3dd09a12664da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:46.841632 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdf6cdc7e534e9ca1b3dd09a12664da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:46.842311 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdf6cdc7e534e9ca1b3dd09a12664da'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:46.854296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1441/2862] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:46 2022] DELETE /identity/v3/users/8fdf6cdc7e534e9ca1b3dd09a12664da => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:46.858683 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:46.859016 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:46.859296 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:46.877563 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:46.878996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:46.937364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1422/2863] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:46.946681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:46.948259 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:47.005679 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494c512-d253-467b-abce-0226e07c9bbe admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:47.009267 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:47.009907 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:47.010193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:47.010467 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:47.019317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:47.020775 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:47.030044 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1442/2864] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:47.294826 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:47.296609 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:47.309106 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dfa5dd-e29b-4485-ae8c-ae49cd53fba6 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:47.313925 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:47.314895 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:47.315254 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:47.315627 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] PATH_INFO: `/v3/projects/c0406f6cce0c47a189f3ce695e21126e` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:47.316886 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0406f6cce0c47a189f3ce695e21126e)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:47.318882 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:47.367852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0406f6cce0c47a189f3ce695e21126e', 'request_id': 'req-0f124703-a398-49b9-afc9-3280a3c20433'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.375901 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0406f6cce0c47a189f3ce695e21126e', 'request_id': 'req-0f124703-a398-49b9-afc9-3280a3c20433'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.381734 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0406f6cce0c47a189f3ce695e21126e', 'request_id': 'req-0f124703-a398-49b9-afc9-3280a3c20433'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.392811 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] The token cache is being invalidate because project c0406f6cce0c47a189f3ce695e21126e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:47.393097 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.393724 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.395800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1423/2865] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:47 2022] DELETE /identity/v3/projects/c0406f6cce0c47a189f3ce695e21126e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:47.399713 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:47.409075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8852c-8c37-4eea-8442-239f72e98cd8 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:47.452388 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:47.465503 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:47.466369 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:47.466647 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:47.466952 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] PATH_INFO: `/v3/users/0d93b9c559d041d6b3e273b8cddff942` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:47.468121 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d93b9c559d041d6b3e273b8cddff942)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:47.470074 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:47.513560 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d93b9c559d041d6b3e273b8cddff942'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.523779 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d93b9c559d041d6b3e273b8cddff942'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.524393 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d93b9c559d041d6b3e273b8cddff942'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.536819 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d93b9c559d041d6b3e273b8cddff942'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.537439 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-c649f637-0607-46ab-b772-19d1cc32d92b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d93b9c559d041d6b3e273b8cddff942'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.550119 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1443/2866] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:47 2022] DELETE /identity/v3/users/0d93b9c559d041d6b3e273b8cddff942 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:47.822506 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:47.824079 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:47.839768 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f124703-a398-49b9-afc9-3280a3c20433 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:47.897153 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:47.898024 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:47.898309 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:47.898586 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] PATH_INFO: `/v3/projects/e9147434d9aa4f5dab2861995b2aea35` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:47.899800 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9147434d9aa4f5dab2861995b2aea35)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:47.901716 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:47.911955 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:47.949187 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9147434d9aa4f5dab2861995b2aea35', 'request_id': 'req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.956193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9147434d9aa4f5dab2861995b2aea35', 'request_id': 'req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.962575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9147434d9aa4f5dab2861995b2aea35', 'request_id': 'req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.973290 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] The token cache is being invalidate because project e9147434d9aa4f5dab2861995b2aea35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:47.973581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.974239 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-2f477bd4-9fe8-4a96-b468-6114a9d3caa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:47.975846 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1424/2867] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:47 2022] DELETE /identity/v3/projects/e9147434d9aa4f5dab2861995b2aea35 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:47.980660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baa7e3-b9c0-45ca-b50b-661ab2b8c9d3 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:47.980957 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baa7e3-b9c0-45ca-b50b-661ab2b8c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:47.981261 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4baa7e3-b9c0-45ca-b50b-661ab2b8c9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:47.999076 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-b4baa7e3-b9c0-45ca-b50b-661ab2b8c9d3 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:48.000272 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-b4baa7e3-b9c0-45ca-b50b-661ab2b8c9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:48.059020 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1444/2868] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:48.067303 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870e4d-f95c-43d8-bfc3-1d25dfd5493a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.067543 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870e4d-f95c-43d8-bfc3-1d25dfd5493a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.067824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870e4d-f95c-43d8-bfc3-1d25dfd5493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.085598 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-45870e4d-f95c-43d8-bfc3-1d25dfd5493a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:48.086776 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-45870e4d-f95c-43d8-bfc3-1d25dfd5493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:48.094494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1425/2869] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:48.098455 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baa7e3-b9c0-45ca-b50b-661ab2b8c9d3 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.108028 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4baa7e3-b9c0-45ca-b50b-661ab2b8c9d3 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.112545 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.113188 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.113979 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.114252 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.115018 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:27:48.115325 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.116916 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.128239 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1445/2870] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:27:48.132830 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45870e4d-f95c-43d8-bfc3-1d25dfd5493a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.142207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45870e4d-f95c-43d8-bfc3-1d25dfd5493a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.147080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.147728 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.148008 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.148279 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.148953 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.150825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.175697 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1426/2871] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:48 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:48.180995 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.190795 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bbed4e-cb2c-4783-a61e-5b42a73dc00c admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.240137 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:48.248743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.248743 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.249070 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.249317 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.250940 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.253227 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.274176 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1446/2872] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:48 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:48.278379 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.288538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea218e3-6cc6-4189-bf06-9de2af1f32a3 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.293062 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.293711 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.293996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.294277 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.295648 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.297498 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.308223 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1427/2873] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:48.311926 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.322226 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b4655-8550-4306-8c33-63100ec74ea6 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.326681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e663aa9-a770-4ed5-8bfd-e50194a7012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.327364 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663aa9-a770-4ed5-8bfd-e50194a7012c admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.327649 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663aa9-a770-4ed5-8bfd-e50194a7012c admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.327927 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e663aa9-a770-4ed5-8bfd-e50194a7012c admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.328653 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e663aa9-a770-4ed5-8bfd-e50194a7012c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.330223 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e663aa9-a770-4ed5-8bfd-e50194a7012c admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.339812 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1447/2874] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:48.343650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.353771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d0d44-3f5a-4b9f-8059-2ce7b5e1d6e1 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.358408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.359315 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.359601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.359898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] PATH_INFO: `/v3/projects/1d9484cdede9409c92fbce3a170a5a3c/users/62dba7cc76f74637b257ed6fe0ed2b28/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.375488 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9484cdede9409c92fbce3a170a5a3c, user_id=62dba7cc76f74637b257ed6fe0ed2b28, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.378134 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.391377 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1428/2875] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:48 2022] PUT /identity/v3/projects/1d9484cdede9409c92fbce3a170a5a3c/users/62dba7cc76f74637b257ed6fe0ed2b28/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:48.401668 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360efb95-7b33-4ff8-989e-96d1d0d591c0 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.402132 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360efb95-7b33-4ff8-989e-96d1d0d591c0 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.402251 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360efb95-7b33-4ff8-989e-96d1d0d591c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.429242 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-360efb95-7b33-4ff8-989e-96d1d0d591c0 None None] MFA Rules not processed for user `62dba7cc76f74637b257ed6fe0ed2b28`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:48.430466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-360efb95-7b33-4ff8-989e-96d1d0d591c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:48.493589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1448/2876] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:48.498437 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.558589 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb9a7b-bed0-48e1-b5b6-eec37db528ae admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.563287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.563932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.564213 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.564486 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.565172 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.567056 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.590908 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1429/2877] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:48 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:48.594847 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360efb95-7b33-4ff8-989e-96d1d0d591c0 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.608470 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360efb95-7b33-4ff8-989e-96d1d0d591c0 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.665182 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.665857 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.666142 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.666418 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.667156 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.669065 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.689330 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1449/2878] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:48 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:48.692934 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.703087 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631b96-99d3-4c44-abb0-a5a0ce8bf20e admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.707671 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.708328 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.708614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.708892 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.709617 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.711228 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.721606 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1430/2879] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:48.726062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.735998 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73828719-6bb5-4727-bc25-0ae63b700b12 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.741374 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.742254 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.742537 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.742813 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] PATH_INFO: `/v3/projects/454204809e44446b8f47ddd98b17c960/users/98c0dc94da6b49819a0c55e1634c2775/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.757356 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454204809e44446b8f47ddd98b17c960, user_id=98c0dc94da6b49819a0c55e1634c2775, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.760187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.774085 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1450/2880] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:48 2022] PUT /identity/v3/projects/454204809e44446b8f47ddd98b17c960/users/98c0dc94da6b49819a0c55e1634c2775/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 20:27:48.779940 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.793922 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f56596-aa5b-4633-a170-e537a6515db2 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.801583 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:48.853316 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b8e1f-736d-4cad-b03b-6c1d9bfde605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.854006 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b8e1f-736d-4cad-b03b-6c1d9bfde605 admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.854294 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b8e1f-736d-4cad-b03b-6c1d9bfde605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.854575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b8e1f-736d-4cad-b03b-6c1d9bfde605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.855356 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b8e1f-736d-4cad-b03b-6c1d9bfde605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.856954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b8e1f-736d-4cad-b03b-6c1d9bfde605 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.866678 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1431/2881] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 20:27:48.870889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:48.880938 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913849-8027-4aa1-8857-00e40ed01167 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:48.885693 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:48.886606 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.886932 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.887208 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] PATH_INFO: `/v3/projects/454204809e44446b8f47ddd98b17c960/users/98c0dc94da6b49819a0c55e1634c2775/roles/2ea8b640824944d8b1f7628b0fdf4f74` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.889171 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=454204809e44446b8f47ddd98b17c960, user_id=98c0dc94da6b49819a0c55e1634c2775, role_id=2ea8b640824944d8b1f7628b0fdf4f74)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:48.892001 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:48.902760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1451/2882] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:48 2022] PUT /identity/v3/projects/454204809e44446b8f47ddd98b17c960/users/98c0dc94da6b49819a0c55e1634c2775/roles/2ea8b640824944d8b1f7628b0fdf4f74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:48.966324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:48.966616 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:48.966939 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:48.993650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] MFA Rules not processed for user `98c0dc94da6b49819a0c55e1634c2775`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:48.994937 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:49.061982 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1432/2883] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:49.073623 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:49.075557 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:49.094466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:49.134293 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563fb9b-9a9e-438f-960e-cbe3c2535f6e admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:49.137936 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:49.138575 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:49.138879 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:49.139159 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:49.195592 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:49.197021 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:49.205939 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1452/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:53.331174 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:53.332576 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:53.344669 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40382a-9dd2-4f9b-addf-31b82ed7fba7 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:53.348195 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456dddd5-f3e0-40a9-b393-6b05fdaad380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:53.348825 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dddd5-f3e0-40a9-b393-6b05fdaad380 service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:53.349713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dddd5-f3e0-40a9-b393-6b05fdaad380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:53.349986 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456dddd5-f3e0-40a9-b393-6b05fdaad380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:53.358799 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dddd5-f3e0-40a9-b393-6b05fdaad380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:53.360287 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456dddd5-f3e0-40a9-b393-6b05fdaad380 service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:53.369834 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1433/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:58.218039 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:58.282078 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c04128-1fe6-4e1c-b8dc-0eb357f2e290 service cinder] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:58.286766 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:58.287671 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:58.287950 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:58.288224 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] PATH_INFO: `/v3/users/62dba7cc76f74637b257ed6fe0ed2b28` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:58.289395 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] RBAC: Authorizing `identity:delete_user(user_id=62dba7cc76f74637b257ed6fe0ed2b28)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:58.291407 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:58.336497 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62dba7cc76f74637b257ed6fe0ed2b28'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.345112 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62dba7cc76f74637b257ed6fe0ed2b28'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.345746 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62dba7cc76f74637b257ed6fe0ed2b28'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.357662 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62dba7cc76f74637b257ed6fe0ed2b28'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.358310 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62dba7cc76f74637b257ed6fe0ed2b28'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.359547 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:58.372762 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1453/2886] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:58 2022] DELETE /identity/v3/users/62dba7cc76f74637b257ed6fe0ed2b28 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:58.377364 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:58.377823 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:58.377942 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:58.395827 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:58.397538 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:58.454362 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1434/2887] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:27:58.464770 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:58.466170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:58.522618 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157253cb-0382-4230-8b8c-36dc9602983a admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:58.526292 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:58.526954 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:58.527238 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:58.527510 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:58.536771 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:58.538299 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:58.547868 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1454/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:27:58.809494 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:58.810996 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:58.824155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070c75-ce5c-4d04-95c8-78a06ae5f66a None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:58.828782 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:58.829792 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:58.830086 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:58.830360 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] PATH_INFO: `/v3/projects/1d9484cdede9409c92fbce3a170a5a3c` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:58.831582 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9484cdede9409c92fbce3a170a5a3c)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:58.833639 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:58.846898 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=100 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:58.882634 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9484cdede9409c92fbce3a170a5a3c', 'request_id': 'req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.889649 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9484cdede9409c92fbce3a170a5a3c', 'request_id': 'req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.895215 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9484cdede9409c92fbce3a170a5a3c', 'request_id': 'req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.905881 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] The token cache is being invalidate because project 1d9484cdede9409c92fbce3a170a5a3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:58.906165 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.906779 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:58.908324 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1435/2889] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:58 2022] DELETE /identity/v3/projects/1d9484cdede9409c92fbce3a170a5a3c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:58.912880 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:58.922550 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17da7a-1d2f-4e46-86d8-42f7569eb9b9 service neutron] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:58.976869 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:58.977660 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:58.977943 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:58.978220 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] PATH_INFO: `/v3/users/98c0dc94da6b49819a0c55e1634c2775` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:58.979422 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c0dc94da6b49819a0c55e1634c2775)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:58.981332 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.026064 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c0dc94da6b49819a0c55e1634c2775'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.032925 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c0dc94da6b49819a0c55e1634c2775'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.033617 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c0dc94da6b49819a0c55e1634c2775'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.045597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c0dc94da6b49819a0c55e1634c2775'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.046466 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8123c6cd-22c1-4dfa-acba-d3b1edd30507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c0dc94da6b49819a0c55e1634c2775'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.060175 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1455/2890] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:27:58 2022] DELETE /identity/v3/users/98c0dc94da6b49819a0c55e1634c2775 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:59.322047 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:59.323528 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:59.336647 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b96b9f-f84e-48ff-b0ca-a595a2fc9591 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:59.394874 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:59.395736 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.396022 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.396824 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] PATH_INFO: `/v3/projects/454204809e44446b8f47ddd98b17c960` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.398000 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454204809e44446b8f47ddd98b17c960)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:59.399932 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.446318 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454204809e44446b8f47ddd98b17c960', 'request_id': 'req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.454204 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454204809e44446b8f47ddd98b17c960', 'request_id': 'req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.460167 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454204809e44446b8f47ddd98b17c960', 'request_id': 'req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.471156 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] The token cache is being invalidate because project 454204809e44446b8f47ddd98b17c960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80412) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:27:59.471444 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.472071 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-aa62867a-1e06-4c5b-a2f1-bf2ef4377468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:27:59.473640 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1436/2891] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:27:59 2022] DELETE /identity/v3/projects/454204809e44446b8f47ddd98b17c960 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:59.480098 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673e54-889c-479d-9a50-b69572b05a29 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.480589 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673e54-889c-479d-9a50-b69572b05a29 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.480706 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59673e54-889c-479d-9a50-b69572b05a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.499288 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-59673e54-889c-479d-9a50-b69572b05a29 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:59.500426 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-59673e54-889c-479d-9a50-b69572b05a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:59.505661 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:59.560681 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1456/2892] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:59.569358 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cbc70-0617-4159-9ecd-01fc25f6fa44 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.569650 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cbc70-0617-4159-9ecd-01fc25f6fa44 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.569976 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cbc70-0617-4159-9ecd-01fc25f6fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.588407 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-432cbc70-0617-4159-9ecd-01fc25f6fa44 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:59.589614 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-432cbc70-0617-4159-9ecd-01fc25f6fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:59.597758 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1437/2893] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:27:59.602465 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673e54-889c-479d-9a50-b69572b05a29 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:59.611978 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59673e54-889c-479d-9a50-b69572b05a29 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:59.616594 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:59.617240 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.617524 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.617800 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] PATH_INFO: `/v3/domains` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.618521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80413) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 20:27:59.618827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:59.620449 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.632552 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1457/2894] 10.222.0.48 () {58 vars in 1152 bytes} [Thu May 26 20:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 20:27:59.636963 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cbc70-0617-4159-9ecd-01fc25f6fa44 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:59.647265 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cbc70-0617-4159-9ecd-01fc25f6fa44 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:59.651921 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:59.652568 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.652852 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.653127 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.653814 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:59.655771 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.680523 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1438/2895] 10.222.0.48 () {60 vars in 1152 bytes} [Thu May 26 20:27:59 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 20:27:59.684600 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:59.695199 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387074a3-e846-4f2c-a521-f47340c85413 admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:59.749106 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:59.749820 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.750058 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.750335 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] PATH_INFO: `/v3/users` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.751047 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:59.752955 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.773760 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1458/2896] 10.222.0.48 () {60 vars in 1143 bytes} [Thu May 26 20:27:59 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 20:27:59.777831 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:59.783236 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:27:59.789713 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c330eb2-827b-4e0c-a8cf-66f004e97738 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:59.795319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:59.796784 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.799291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.799291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] PATH_INFO: `/v3/roles` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.799291 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:59.799958 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.812226 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1439/2897] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:59.816181 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:59.826602 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b196df-7872-4966-b740-1dfad5e09aaf admin admin] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:59.831221 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17387fff-4ea6-4551-bbd3-73891bfe4bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:59.831884 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387fff-4ea6-4551-bbd3-73891bfe4bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.832170 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387fff-4ea6-4551-bbd3-73891bfe4bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.832447 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17387fff-4ea6-4551-bbd3-73891bfe4bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.833172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17387fff-4ea6-4551-bbd3-73891bfe4bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:59.835387 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17387fff-4ea6-4551-bbd3-73891bfe4bb9 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.845241 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1459/2898] 10.222.0.48 () {58 vars in 1121 bytes} [Thu May 26 20:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 20:27:59.849332 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:27:59.859193 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686fe236-1209-4b58-8ee8-4a5e6804c60f admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:27:59.863947 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:27:59.864838 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.865103 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.865378 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] PATH_INFO: `/v3/projects/ea851a1dc0534c68a2aa122859ce2f42/users/d9655378d4ae4b468d8bd23a5356417b/roles/2f1a975d114c4307b75105be01055d98` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.879575 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea851a1dc0534c68a2aa122859ce2f42, user_id=d9655378d4ae4b468d8bd23a5356417b, role_id=2f1a975d114c4307b75105be01055d98)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:27:59.882725 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:27:59.895201 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1440/2899] 10.222.0.48 () {60 vars in 1482 bytes} [Thu May 26 20:27:59 2022] PUT /identity/v3/projects/ea851a1dc0534c68a2aa122859ce2f42/users/d9655378d4ae4b468d8bd23a5356417b/roles/2f1a975d114c4307b75105be01055d98 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:27:59.906948 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b2b9-3670-41d8-ba1a-68539bfb876b None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:27:59.907244 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b2b9-3670-41d8-ba1a-68539bfb876b None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:27:59.907521 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc12b2b9-3670-41d8-ba1a-68539bfb876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:27:59.933429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-dc12b2b9-3670-41d8-ba1a-68539bfb876b None None] MFA Rules not processed for user `d9655378d4ae4b468d8bd23a5356417b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:27:59.934624 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-dc12b2b9-3670-41d8-ba1a-68539bfb876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:27:59.997865 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1460/2900] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:27:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:28:00.009355 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:00.011141 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:00.066251 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69535146-7956-49a5-9bee-4e0af83a37e9 admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:00.070410 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839c41b-d977-4269-bf28-447a81732d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4225e82ea268483daa86078abb11c7f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:00.071080 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c41b-d977-4269-bf28-447a81732d3a service cinder] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:00.071367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c41b-d977-4269-bf28-447a81732d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:00.071645 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839c41b-d977-4269-bf28-447a81732d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:00.079903 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839c41b-d977-4269-bf28-447a81732d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:00.081319 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839c41b-d977-4269-bf28-447a81732d3a service cinder] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:00.089954 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1441/2901] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:28:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:28:01.434673 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:01.435196 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:01.435331 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:01.447728 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:01.454690 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] MFA Rules not processed for user `d9655378d4ae4b468d8bd23a5356417b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:28:01.456037 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:01.463669 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1461/2902] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:28:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:28:10.086020 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:15.198041 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c753c-5c69-4ecc-8534-6c26112d36f0 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:15.198635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c753c-5c69-4ecc-8534-6c26112d36f0 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:15.198635 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c753c-5c69-4ecc-8534-6c26112d36f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:15.255155 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-1e9c753c-5c69-4ecc-8534-6c26112d36f0 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:28:15.256367 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-1e9c753c-5c69-4ecc-8534-6c26112d36f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:15.320439 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1442/2903] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:28:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:28:15.364509 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:15.365896 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:15.454298 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25a990-5c04-41e8-b368-0c2688c37727 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:15.459162 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:15.459794 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:15.460075 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:15.460372 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:15.468172 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:15.469726 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:15.478000 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1462/2904] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:28:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:28:15.973816 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6918b5-9ec0-4ddd-a655-5030a8e0c6db None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:15.974116 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6918b5-9ec0-4ddd-a655-5030a8e0c6db None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:15.974400 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6918b5-9ec0-4ddd-a655-5030a8e0c6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:15.992569 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-7b6918b5-9ec0-4ddd-a655-5030a8e0c6db None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:28:15.993777 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7b6918b5-9ec0-4ddd-a655-5030a8e0c6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:16.001111 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1443/2905] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 20:28:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:28:16.012833 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:16.023786 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e32032-b8d6-4fd7-9e70-79cd58ebb0e6 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:16.028688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:16.029314 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:16.029597 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:16.029877 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:16.037860 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:16.040049 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:16.048082 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1463/2906] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:28:16.232526 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f588-97c3-4a90-bb27-08a2fee9618f None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:16.233002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f588-97c3-4a90-bb27-08a2fee9618f None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:16.233104 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f588-97c3-4a90-bb27-08a2fee9618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:16.250793 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-6ba6f588-97c3-4a90-bb27-08a2fee9618f None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:28:16.251995 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-6ba6f588-97c3-4a90-bb27-08a2fee9618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:16.259466 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1444/2907] 10.222.0.48 () {58 vars in 1009 bytes} [Thu May 26 20:28:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:28:16.271104 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:16.282348 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfea09e-6af2-4181-a415-574551bd4a45 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:16.287573 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:16.288214 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:16.288526 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:16.288803 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:16.297187 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:16.298749 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:16.306627 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1464/2908] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 20:28:16.617977 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ac3cf-6d01-499b-ac29-fa122f777e23 None None] REQUEST_METHOD: `POST` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:16.618271 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ac3cf-6d01-499b-ac29-fa122f777e23 None None] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:16.618555 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ac3cf-6d01-499b-ac29-fa122f777e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:16.637857 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.auth.core [None req-b31ac3cf-6d01-499b-ac29-fa122f777e23 None None] MFA Rules not processed for user `29b2238abdfd4140a850d53943fb931e`. Rule list: `[]` (Enabled: `True`). {{(pid=80412) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:28:16.639090 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-b31ac3cf-6d01-499b-ac29-fa122f777e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:16.646146 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1445/2909] 10.222.0.48 () {58 vars in 967 bytes} [Thu May 26 20:28:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 20:28:16.658297 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:16.669563 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c486e-d2c7-47ca-9450-59ede0944d33 service swift] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:16.674827 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987affb-1397-4b2b-97c7-f363a1588a96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b80af2efebf440959ceb238bd27cf7f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:16.675496 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987affb-1397-4b2b-97c7-f363a1588a96 service swift] REQUEST_METHOD: `GET` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:16.675782 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987affb-1397-4b2b-97c7-f363a1588a96 service swift] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:16.676062 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987affb-1397-4b2b-97c7-f363a1588a96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:16.685067 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987affb-1397-4b2b-97c7-f363a1588a96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:16.686675 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987affb-1397-4b2b-97c7-f363a1588a96 service swift] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:16.695400 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1465/2910] 10.222.0.48 () {60 vars in 1384 bytes} [Thu May 26 20:28:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 20:28:18.896787 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ac3cf-6d01-499b-ac29-fa122f777e23 None None] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:18.958160 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ac3cf-6d01-499b-ac29-fa122f777e23 None None] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:18.962578 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:18.963474 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:18.963756 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:18.964027 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] PATH_INFO: `/v3/users/d9655378d4ae4b468d8bd23a5356417b` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:18.965181 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9655378d4ae4b468d8bd23a5356417b)` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:18.967133 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:19.011350 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:19.012889 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9655378d4ae4b468d8bd23a5356417b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.013619 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9655378d4ae4b468d8bd23a5356417b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.014341 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9655378d4ae4b468d8bd23a5356417b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.021781 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9655378d4ae4b468d8bd23a5356417b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.033422 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.notifications [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9655378d4ae4b468d8bd23a5356417b'} {{(pid=80412) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.045492 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1446/2911] 10.222.0.48 () {58 vars in 1223 bytes} [Thu May 26 20:28:18 2022] DELETE /identity/v3/users/d9655378d4ae4b468d8bd23a5356417b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:28:19.050296 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] REQUEST_METHOD: `POST` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:19.050790 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:19.050913 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:19.068722 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.auth.core [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] MFA Rules not processed for user `561da2b4baef46ee96092703640e527b`. Rule list: `[]` (Enabled: `True`). {{(pid=80413) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 20:28:19.069968 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:19.126787 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1466/2912] 10.222.0.48 () {58 vars in 957 bytes} [Thu May 26 20:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 20:28:19.136484 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:19.137872 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:19.195601 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73895252-cfe2-4d87-b63f-5f8308030d3d admin admin] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:19.199089 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8751982010ae4b7eb6c855aea7540a23', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:19.199731 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:19.200011 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:19.200284 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:19.209408 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:19.210818 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:19.220171 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1447/2913] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 20:28:19.390791 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] Authenticating user token {{(pid=80413) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:28:19.392341 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.fernet_utils [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80413) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:28:19.404889 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185df2f-b7a5-451f-9314-d51f1497b087 None None] Validating token access rules against request {{(pid=80413) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:28:19.409565 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '561da2b4baef46ee96092703640e527b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd99a6eb193bd41428c297fd4b90b9d66', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80413) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:28:19.410429 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:28:19.410720 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:28:19.411035 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] PATH_INFO: `/v3/projects/ea851a1dc0534c68a2aa122859ce2f42` {{(pid=80413) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:28:19.412235 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea851a1dc0534c68a2aa122859ce2f42)` {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:28:19.414688 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] RBAC: Authorization granted {{(pid=80413) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:28:19.445283 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:19.462802 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea851a1dc0534c68a2aa122859ce2f42', 'request_id': 'req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.468193 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea851a1dc0534c68a2aa122859ce2f42', 'request_id': 'req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.474360 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea851a1dc0534c68a2aa122859ce2f42', 'request_id': 'req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670'} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.487166 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] The token cache is being invalidate because project ea851a1dc0534c68a2aa122859ce2f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80413) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 20:28:19.487454 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.488174 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG keystone.notifications [None req-8b2fbfdc-54d0-4807-8b0b-e6eeb6d47670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80413) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 20:28:19.489987 dv-cinder-842131-1-smb devstack@keystone.service[80413]: [pid: 80413|app: 0|req: 1467/2914] 10.222.0.48 () {58 vars in 1232 bytes} [Thu May 26 20:28:19 2022] DELETE /identity/v3/projects/ea851a1dc0534c68a2aa122859ce2f42 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 20:28:29.216002 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=39,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:28:29.484094 dv-cinder-842131-1-smb devstack@keystone.service[80413]: DEBUG dbcounter [-] [80413] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80413) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:31:12.043207 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] Authenticating user token {{(pid=80412) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:31:12.044848 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:31:12.116527 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cface2-01f4-436e-bfb8-99e4d5cff33d service neutron] Validating token access rules against request {{(pid=80412) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:31:12.175622 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703a962-84a5-47c1-bf3b-81172b51c1a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1425168ddd274cf3a5c59d0cbedaf0f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6201c0c838f44f049269e40cfce28153', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80412) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:31:12.176266 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a962-84a5-47c1-bf3b-81172b51c1a9 service placement] REQUEST_METHOD: `GET` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:31:12.176581 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a962-84a5-47c1-bf3b-81172b51c1a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:31:12.176861 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703a962-84a5-47c1-bf3b-81172b51c1a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80412) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:31:12.178695 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.fernet_utils [None req-7703a962-84a5-47c1-bf3b-81172b51c1a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80412) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:31:12.190388 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a962-84a5-47c1-bf3b-81172b51c1a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:31:12.191980 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703a962-84a5-47c1-bf3b-81172b51c1a9 service placement] RBAC: Authorization granted {{(pid=80412) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:31:12.202144 dv-cinder-842131-1-smb devstack@keystone.service[80412]: [pid: 80412|app: 0|req: 1448/2915] 10.222.0.48 () {60 vars in 1365 bytes} [Thu May 26 20:31:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:31:22.197423 dv-cinder-842131-1-smb devstack@keystone.service[80412]: DEBUG dbcounter [-] [80412] Writing DB stats keystone:SELECT=58 {{(pid=80412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}